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Abstract  Continued 

For  the  former  we  take  a  min-max  approach:  the  signal  and 
noise  spectra  are  assumed  to  belong  to  uncertainty  classes  of 
spectra  and  a  processor  is  specified  which  attains  the  best  pos¬ 
sible  performance  over  the  entire  class-  While  the  classical 
min-max  time  delay  estimation  problem  is  solved  only  in  a 
restricted  sense,  use  is  made  of  the  existing  theory  on  Robust 
(min-max)  Wiener  filtering  to  motivate  an  approximate  min-max 
processor.  Performance  curves  for  the  uncertain  spectra  situa¬ 
tion  show  that  the  approximate  scheme  has  the  potential  to  out¬ 
perform  the  Generalized  Cross  Correlator  (GCC)  class  of  optimal 
processors . 

It  is  well  known  that  as  the  observations  become  narrowband 
the  classical  optimal  time  delay  estimate  degenerates  rapidly  due 
to  the  so  called  "peak  ambiguity"  problem.  For  Gaussian  obser¬ 
vations  in  the  narrowband  case,  this  arises  from  the  multipeaked 
nature  of  the  likelihood  function  over  which  the  global  maximum 
is  acquired.  We  are  interested  in  two  aspects  of  the  problem: 
the  improvement  of  performance,  where  possible,  through  alter¬ 
native  estimation  techniques;  and  the  characterization  of 
the  large  error  performance  of  the  GCC  class.  Two  new  processors 
are  presented,  one  arising  from  constraining  the  optimal  esti¬ 
mator  to  have  low  sidelobes,  and  the  other  derived  from  an  opti¬ 
mization  over  a  new  family  of  processors,  the  Center  of  Symmetry 
Estimator  (CSE).  Simulation  results  for  the  CSE  indicate 
that  it  can  have  significantly  better  large  error  performance 
than  the  GCC.  We  approach  the  performance  characterization  pro¬ 
blem  in  the  following  way:  the  performance  of  the  optimal  esti¬ 
mator  in  the  presence  of  large  errors  is  related  to  the  proba¬ 
bility  that  the  likelihood  function  gives  an  estimate  which  is 
far  removed  from  the  true  time  delay.  This  probability,  in  turn, 
admits  a  representation  in  terms  of  level  up-crossing  proba¬ 
bilities.  In  Chapter  4,  we  present  a  general  theorem  on  the 
asymptotic  behavior  of  the  level  up-crossings  of  a  non-s tationary 
random  process.  Then,  based  on  the  results  of  Chapter  4,  a 
Poisson  model  is  invoked  as  an  approximation  to  the  level 
crossings  and  a  numerical  study  of  the  large  error  probability 
and  the  global  variance  is  undertaken  for  lowpass  and  bandpass 
signal  spectra . • 
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Abstract 

Time  delay  estimation  forms  the  base  from  which  passive  localization  and 
tracking  may  function  accurately.  In  this  thesis  we  consider  both  the  practical 
and  theoretical  aspects  of  time  delay  estimation  when  classical  optimal  estimation 
techniques  break  down.  Of  special  concern  are  two  adverse  situations:  the  under¬ 
lying  statistics  of  the  observations  are  incompletely  specified;  and  the  observa¬ 
tions  contain  a  narrowband  component. 

For  the  former  we  take  a  min-max  approach:  the  signal  and  noise  spectra  are 
assumed  to  belong  to  uncertainty  classes  of  spectra  and  a  processor  is  specified 
which  attains  the  best  possible  performance  over  the  entire  class.  While  the  clas¬ 
sical  min-max  time  delay  estimation  problem  is  solved  only  in  a  restricted  sense, 
use  is  made  of  the  existing  theory  on  Robust  (min-max)  Wiener  filtering  to 
motivate  an  approximate  min-max  processor.  Performance  curves  for  the  uncer¬ 
tain  spectra  situation  show  that  the  approximate  scheme  has  the  potential  to  out¬ 
perform  the  Generalized  Cross  Correlator  (GCC)  class  of  optimal  processors. 


It  is  well  known  that  as  the  observations  become  narrowband  the  classical 
optimal  time  delay  estimate  degenerates  rapidly  due  to  the  so  called  "peak  ambi¬ 
guity”  problem.  For  Gaussian  observations  in  the  narrowband  case,  this  arises 
from  the  multipeaked  nature  of  the  likelihood  function  over  which  the  global 
maximum  is  acquired.  We  are  interested  in  two  aspects  of  the  problem:  the 
improvement  of  performance,  where  possible,  through  alternative  estimation  tech¬ 
niques;  and  the  characterization  of  the  large  error  performance  of  the  GCC  class. 
Two  new  processors  are  presented,  one  arising  from  constraining  the  optimal  esti¬ 
mator  to  have  low  sidelobes,  and  the  other  derived  from  an  optimization  over  a 
new  family  of  processors,  the  Center  of  Symmetry  Estimator  (CSE).  Simulation 
results  for  the  CSE  indicate  that  it  can  have  significantly  better  large  error  per¬ 
formance  than  the  GCC.  We  approach  the  performance  characterization  problem 
in  the  following  way:  the  performance  of  the  optimal  estimator  in  the  presence  of 
large  errors  is  related  to  the  probability  that  the  likelihood  function  gives  an  esti¬ 
mate  which  is  far  removed  from  the  true  time  delay.  This  probability,  in  turn, 
admits  a  representation  in  terms  of  level  up-crossing  probabilities.  In  Chapter  4, 
we  present  a  general  theorem  on  the  asymptotic  behavior  of  the  level  up-crossings 
of  a  non-stationary  random  process.  Then,  based  on  the  results  of  Chapter  4,  a 
Poisson  model  is  invoked  as  an  approximation  to  the  level  crossings  and  a  numer¬ 
ical  study  of  the  large  error  probability  and  the  global  variance  is  undertaken  for 
lowpass  and  bandpass  signal  spectra. 
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Chapter  1 
Introduction 

Time  delays  are  inherent  to  many  important  problems  in  a  variety  of  scien¬ 
tific  and  engineering  disciplines.  In  observational  astronomy,  very  long  baseline 
interferometry  (VLBI)  uses  the  relative  delays  between  multiple  measurements, 
taken  at  widely  separated  sensors,  to  compute  the  positions  of  heavenly  bodies. 
In  radio  communications,  increases  in  the  received  signal  energy  are  possible 
through  coherent  (time- aligned)  combination  of  the  outputs  of  a  multi-sensor 
antenna  array.  As  an  example  from  medical  research,  studies  in  evoked  poten¬ 
tials  involve  computing  the  reaction  time  of  a  subject  to  different  forms  of 
stimuli.  Essentially,  in  any  situation  where  measurements  are  taken  at  multiple 
points  in  space  in  order  to  resolve  or  utilize  certain  characteristics  of  a  propagat¬ 
ing  signal,  the  inter-sensor  propagation  time  is  of  prime  importance. 

For  the  two  sensor,  linear  inter-sensor  channel  case,  cross-  correlation  of  the 
sensor  outputs  produces  a  global  peak  at  the  true  delay.  However,  the  presence 
of  significant  random  sensor  noise  makes  it  essential  to  pre-process  the  outputs, 
prior  to  correlation,  in  order  to  obtain  acceptable  peak  type  estimates  of  the 
delay  parameter.  The  susceptability  of  correlation  peak  estimates  to  various  fac¬ 
tors  such  as:  unknown  signal  statistics,  low  signal  bandwidth,  high  center  fre¬ 
quency  and  small  observation  time,  is  well  documented  in  the  literature.  In  this 
thesis  we  concentrate  on:  1).  developing  cross-correlation  techniques  which  are 
less  sensitive  to  the  above  factors,  and  2).  better  characterizing  the  (large  error) 
performance  of  peak  detection  type  correlation  estimates  relative  to  the  unfavor¬ 
able  conditions  above.  The  main  results  in  these  directions  are  organized  into 
four  chapters  (Chapters  2,3  and  6  deal  with  1).,  Chapter  5  deals  with  2).).  The 
remaining  chapter,  Chapter  4,  contains  results  which  are  supportive  to  Chapter 
5.  Chapters  2, 3, 4, 5  and  6  are  briefly  summarized  below. 
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Chapter  2  sets  up  the  formal  problem  definition.  Then  a  unifying  interpreta¬ 
tion  of  several  of  the  classical  Generalized  Cross  Correlation  (GCC)  methods  is 
given  in  terms  of  signal-to-noise  ratio  (SNR).  The  main  result  is  the  development 
of  a  new  GCC  motivated  from  Least  Mean  Square  Error  (LMSE)  filtering  of  the 
sensors.  A  first  step  towards  obtaining  robust  estimates  of  time  delay,  under 
uncertainty  on  the  signal  and  noise  spectra,  is  acheived  by  implementing  robust 
Wiener  filters  in  place  of  the  global  LMSE  filters  for  the  signal.  Finally  a  numer¬ 
ical  evaluation  of  performance  is  undertaken  to  compare  the  new  techniques  to 
some  of  the  well  known  GCCs. 

In  Chapter  3,  an  alternate  approach  is  proposed:  one  obtains  the  time  delay 
estimate  by  means  of  an  approximation  to  the  center  of  symmetry  of  the  GCC 
rather  by  the  conventional  peak  detection  method.  A  class  of  center  of  symmetry 
estimators  (CSE)  is  defined  using  the  Fourier  coefficients  of  the  GCC,  and  an 
approximate  expression  for  the  estimator  variance  is  derived.  An  optimal 
(minimum  variance)  CSE  is  then  obtained  which  is  compared  to  the  optimal 
(minimum  variance)  GCC  by  simulation.  The  results  of  the  simulation  indicate 
that  for  the  difficult  case  of  narrowband  signals,  the  optimal  CSE  has  much 
better  performance  than  the  GCC  for  low  SNR,  and  nearly  identical  performance 
for  high  SNR. 

While  Chapter  4  is  not  directly  related  to  time  delay  estimation,  it  provides 
the  theoretical  background  for  Chapter  5,  which  is  concerned  with  more  widely 
applicable  GCC  variance  approximations  than  those  currently  available  in  the 
literature.  Chapter  4  contains  material  on  the  asymptotic  distribution  of  level 
crossing  probabilities.  Several  authors  have  studied  the  weak  convergence  of  the 
number  of  level  crossings,  N(t),  of  a  given  stationary  random  process  over  an 
interval  [0 ,t],  to  a  Poisson  random  count  process,  as  the  level  is  allowed  to 
become  large  and  the  length  of  the  interval  is  suitably  normalized.  In  Chapter  4 


-3- 


results  are  obtained  for  the  distribution  of  level  up-crossings  by  a  non-stationary 
random  process.  It  is  established  that,  under  certain  regularity  conditions,  the 
asymptotic  distribution  is  again  Poisson,  but  with  an  inhomogeneous  (time  vary¬ 
ing)  rate  parameter.  This  is  accomplished  by  showing  that  the  up-crossing  pro¬ 
bability  obeys  an  asymptotically  linear,  first  order  integral  equation. 

In  Chapter  5  a  level  crossing  approach  is  developed  to  model  the  large  error 
performance  of  the  GCC.  In  the  past,  large  error  variance  expressions  were 
developed  for  the  large  bandwidth-time  product  (BT)  case,  which  involve  com¬ 
puting  the  probabilities  of  level  exceedance  by  a  finite,  but  large,  number  of  time 
samples  along  the  GCC  trajectory.  Essential  to  these  previous  methods  is  the 
assumption  that  the  sidelobe  activity  of  the  GCC  is  negligible,  a  tenuous  assump¬ 
tion  for  low  BT  or  highly  narrowband  signal  spectra.  In  Chapter  5  the  expected 
number  of  up-crossings  of  a  level  by  the  GCC  yields  insights  into  the  large  error 
performance  of  the  GCC  for  situations  where  reliable  indicators  could  only  be 
provided  by  experiment.  Motivated  by  the  results  of  Chapter  4,  a  Poisson 
approximation  to  the  large  error  variance  is  derived.  Numerical  studies  of  the 
Poisson  approximation  reveal  several  effects  on  performance  of  highly  nar¬ 
rowband  signals.  Some  of  these  effects  match  the  behavior  of  the  Ziv-Zakai 
Lower  Bound  (ZZLB)  on  the  variance  of  the  optimal  estimate,  but  were  not 
detected  by  other  large  error  approximations  reported  in  the  literature. 

Finally  Chapter  6  informally  explores  two  new  and  interesting  techniques  of 
performing  time  delay  estimation.  One  of  these  is  developed  specifically  for  highly 
oscillatory  periodic  signals.  It  is  motivated  by  the  behavior  of  lower  bounds  (the 
ZZLB  and  others)  on  the  variance  of  the  optimal  estimator.  The  resultant  struc¬ 
ture  for  the  estimator  is  a  hybrid  GCC  processor  which  acts  on  the  observations 
and  their  envelopes  to  obtain  an  optimal  estimate.  A  constrained  optimization  of 
the  local  (small  error)  and  the  global  (large  error)  variance  specifies  a  GCC 
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which,  on  the  one  hand,  implements  the  locally  optimal  estimator,  and  on  the 
other  hand,  passes  the  locally  optimal  estimate  through  a  tapped  delay  line 
(equalization)  to  suppress  its  large  error-prone  sidelobes.  The  second  technique 
investigated  in  this  chapter  uses  a  functional  transformation  on  the  cross- 
correlation  which  allows  us  to  replace  the  inherently  non-linear  time  delay  esti¬ 
mation  problem  with  a  linear  estimation  problem  (observations  =  delay  +  noise) 
under  certain  circumstances.  Finally  some  optimal  and  sub-optimal  processing 
structures  are  presented,  based  on  the  above  linearization.  A  preliminary  analysis 
of  performance  concludes  the  chapter. 
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Chapter  2 

The  Wiener  Processor  for  Time  Delay 
I.  Introduction 

In  this  chapter  a  general  form  of  the  time  delay  estimation  problem  of 
interest  will  be  stated.  In  Section  II,  cross-correlation  type  processors  will  be 
motivated  and  the  Generalized  Cross-Correlator  (GCC)  will  be  defined.  A  corre¬ 
lation  domain  signal-to-  noise  ratio  (SNR)  approach  will  be  adopted  to  derive 
three  of  the  classical  "optimal”  GCCs  in  a  unified  manner.  Although  the  concept 
of  using  SNR  as  a  GCC  optimization  criterion  is  not  new  (two  of  these  optimal 
GCCs  were  derived  in  this  way  by  their  respective  authors),  the 
Hannan- Thomson  GCC  (HT)  has  not  previously  been  considered  in  this  light.  In 
chapter  6  one  of  the  SNRs  defined  here,  the  one  associated  with  the  optimization 
yielding  the  HT,  will  be  shown  to  have  a  special  significance  for  the  theoretical 
performance  of  the  globally  optimal  (minimum  variance)  estimator.  We  conclude 
the  introductory  part  of  this  chapter  with  a  discussion  of  an  ”ad  hoc”  or  intuitive 
GCC,  the  Smoothed  Coherence  Transform  (SCOT). 

In  Section  ID,  the  main  result  of  the  chapter  is  presented,  the  derivation  of 
the  Wiener  Processor  (  WP).  This  derivation  is  obtained  by  focusing  on  the 
observation  domain,  as  opposed  to  the  cross-correlation  domain.  A  numerical 
study  is  presented  in  Section  V  which  indicates  good  performance  of  the  WP 
relative  to  the  four  other  GCCs  considered  here. 

In  general  the  optimum  processors  are  very  sensitive  to  deviations  from  the 
assumed  signal  and  noise  characteristics.  By  way  of  contrast,  the  SCOT  appears 
to  be  more  robust  to  these  deviations  from  the  nominal  model,  as  has  been  indi¬ 
cated  by  experimental  results.  However,  these  latter  processors  can  have  very 
poor  performance  at  the  nominal  point. 
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In  Section  IV  of  this  chapter,  an  implementation  of  the  WP  as  a  "robust” 
processor  for  spectral  uncertainty  (RWP)  is  discussed.  The  numerical  results  of 
Section  V  indicate  a  R  WP  performance  gain,  over  the  classical  GCCs  mentioned 
above,  at  the  least  favorable  point  in  an  c-contaminated  uncertainty  class  of  spec¬ 
tra.  Hence,  for  the  cases  under  consideration,  the  WP  and  RWP  compare  favor¬ 
ably  to  existing  GCC  methods  of  time  delay  estimation. 

II.  Problem  Statement  and  Background 

We  first  consider  a  system  model  generating  the  observations  in  Fig.  1.  We 
observe  Gaussian,  ergodic,  wide-sense  stationary  processes 

*i(0  =  «(0  +  »i(0  (1) 

*2(0  =  *,(<)  +  n2(t) 

over  a  time  interval  t  6  [0,  T].  The  noises  nx(t)  and  r i2(f)  are  uncorrelated  broad¬ 
band  Gaussian  proceses,  s(t)  is  a  Gaussian  signal  and  s9(t)  =  c(f)*  s(t)  is  a  fil¬ 
tered  version  of  s(t).  In  this  chapter  e(f)  is  a  linear,  time  invariant  channel  having 
a  transfer  function  C{w),  with  unknown  linear  phase,  so  that  s0(t)  is  a  delayed  , 
but  possibly  distorted,  version  of  s(t).  This  delay,  D,  is  a  priori  known  to  lie 
within  the  time  interval  [-Dm  ,Dm }.  Furthermore,  we  assume  that  the  noises  are 
uncorrelated  with  the  signal  and  that  the  observation  time,  T,  is  much  greater 
than  both  the  correlation  time,  Te ,  of  xx(t)  and  x2{t),  and  Dm.  The  object  is 
then  to  estimate  the  time  delay,  D,  associated  with  the  channel. 

We  define  the  sample  (averaged)  cross-correlation 

m  T 

RM  =  -4  E  /  xiki(T)x2k{<7+T)d^  (2) 

1  k- 10 

where  xik  (t)  is  a  time  truncated  version  of  *,•  (f)  for  i  =  1,2 
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xik 


*,  (*) . 
0, 


t  G  \{k-l)T/m,kTlm\ 
otherwise 


(3) 


where  it  is  assumed  that  T/m  »  Te  and  TJm  »  Dm  .  When  m  =  1,  in  (2), 
the  sample  cross-correlation  is  called  a  coherent  estimate  of  the  cross-correlation 
function  R  12.  If  T  is  sufficiently  large  one  can  choose  m  >  1  in  order  to  reduce 
the  variance  of  R  12.  This  latter  procedure  gives  the  so-called  incoherent  cross- 
correlation  estimate.  For  simplicity  of  presentation,  m  =  1  in  the  remainder  of 
this  chapter.  Alternately  (2)  can  be  expressed  in  the  frequency  domain  (for 
T  »  Te ) 


CO 

^12(t)  =  2^-  !  Gl2(co)e^doj  .  (4) 

— OO 

Here  G  j2  =  ~j!  X2,  where  Aj  and  X2  are  the  finite  time  Fourier  transforms 

of  Xj  and  x2.  For  large  observation  time,  is  a  good  approximation  to  the 

true  cross-correlation  function  which  has  a  global  peak  at  D.  In  fact  if  c(t)  is 
pure  delay  and  s(f)  is  white,  the  cross-correlation  function  is  a  delta  function  at 
the  true  delay.  For  finite  observation  time  we  can  decompose  R12(t)  into  the  sum 
of  four  terms 


i?i2(r)  =  c(r)*R  8S  fr)+  c(r)*R  (r)  +  R*sn2(r)  +  R  Din#(r)  (5) 

where  denotes  convolution.  Here  Rsa  (r)  is  an  estimate  of  the  signal  auto¬ 
correlation  function  Rsa  (r),  and  RniS  (r),  Rsn2(r)  and  i?nin2(r)  are  estimates  of  the 
cross-correlation  between  the  respective  signal  and  noise  terms  in  the  observa¬ 
tions.  In  the  limit  ergodicity  guarantees  that  the  sample  cross-correlation  con¬ 
verges  to  c{r)*Rsa  (r),  which  displays  an  absolute  maximum  at  D.  Thus,  it  is  the 
last  three  terms  in  Eq.  (5)  which  constitute  zero  mean  disturbances  affecting  the 
peak  resolution  of  the  first  term.  This  suggests  prefiltering  the  sample  cross- 
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correlation  with  a  filter  W(u)  to  obtain  better  resolution  of  the  peak  at  D.  To 
avoid  the  introduction  of  an  unnecessary  bias  into  the  peak  location  we  confine 
our  attention  to  zero  phase  The  resultant  filtered  sample  cross-correlation 

is  then  searched  over  the  a  priori  region  \-Dm^Dm  ]  for  the  global  peak,  which 
yields  the  time  delay  estimate,  D.  This  scheme  is  referred  to  as  the  generalized 
cross-correlation  method  or  the  Generalized  Cross-Correlator  (G.C.C.)  and  is 
illustrated  in  Fig.  2.  We  denote  the  G.C.C.  output  waveform  R&(t).  Therefore 
we  have 

R ’ M  =  JO  12(w) .  (6) 

-00 

D=  argmax  R3(t) 

re[-Dm,Dm  1 

When  W{u)  is  unity  the  resulting  G.C.C.  is  called  the  simple  cross-correlator 
( C.C. ).  Considering  the  first  term  in  Eq.  (5)  as  a  "signal”  in  additive  noise,  clas¬ 
sical  optimal  filtering  theory  can  be  applied  to  derive  filters  W[u>)  which  maxim¬ 
ize  signal-to-noise  ratio. 

Letting  the  last  three  terms  of  Eqn  (5)  be  characterized  as  "noise”  we  can 
define  a  signal-to-noise  ratio  at  the  output  of  the  GCC  as  the  magnitude  squared 
of  the  global  peak  of  the  "signal”  term  divided  by  the  power  of  the  "noise”  which 
generates  false  peaks  in  R  f2(r).  We  will  denote  this  SNR  j.  For  a  sufficiently 
broadband  signal,  s(f),  the  variance  of  the  cross-correlation  estimate,  Eq.  (2),  out¬ 
side  of  the  immediate  vicinity  of  the  true  delay  is  given  by 

00 

,2(r))  = /  G  u(uf)G  ^[u)du  (7) 

—00 

and  the  variance  of  R„  by 

00 

/  \Gn(^)\2doj 


var{R„  (r))  = 


(8) 
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for  t  7^  D  [12].  G  n(w)  and  G  ^(w)  are  the  power  spectral  densities  of  the  obser¬ 
vations  Jj(f)  and  x2(t)  respectively  and  G  12(w)  is  the  cross-spectrum.  Using  the 
above  results  it  is  straightforward  to  derive  the  cross-correlation  noise  power 
which  is  given  by 


<Tn(r)  =  /  ^nM^22M(H7i2MI2)lvv(w)l2  , 

-00 

|7i2(g;)|2  is  the  magnitude  coherency  squared 

i  ,  ISisMI2 

hl2<w|1  CuMGg (*)  ’ 

Then  from  the  defining  relation 

we  obtain 


r^D  (9) 


(10) 


(11) 


00 

SNR  j  = - — - 

1  CO 

i  /  G„MG22(w)(H-y12M|i!)|mw)|2^ 


(12) 


The  maximum  is  obtained  through  the  Schwarz  inequality  and  yields  the  H.  T. 
processor  for  the  pure  delay  channel.  The  same  result  is  derived  in  [4]  as  the 
result  of  minimizing  the  local  variance  of  the  delay  estimate  over  the  entire 
G.C.C.  class,  and  in  [1]  as  the  result  of  maximum  likelihood  estimation.  The 
filter  is 


Wr.T.  («)  = 


1 

|£  12MI 


b12Ml2 

H7i2H|2 


(13) 


Neglecting  the  effect  of  the  signal  and  noise  cross  terms  ,  c(r)  *Rsn.  (r)  and 
Rsn^r)  in  Eq.  (5),  gives  another  characterization  of  the  noise  in  the  cross- 
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correlation  domain.  With  this  definition  of  noise  another  signal-to-noise  ratio  is 
defined  in  [6],  SNR2,  which  is  shown,  for  pure  delay,  to  be  maximized  by  the 
Eckart  processor  WEK  (ui) 


SNR2 


[■£  /  |e,2M|irMrfw]2 

— oo 
oo 

-OO 


(14) 


Wek(u)  = 


(15) 


where  G#i(w)  and  Gnj(u)  are  the  auto-spectra  of  the  noises  n^t)  and  n2(f) 
respectively.  Note  that  in  terms  of  the  spectra  of  the  observables  xt(f)  and  x2(f), 
the  filter  takes  the  form 


Wek  M  = 


lg12Ml 


Hassab  and  Boucher  [2]  take  the  approach  of  maximizing  a  signal-to-noise 
ratio,  SNR  3,  defined  as  the  ratio  of  the  expected  peak  energy  at  the  true  delay  to 
the  total  statistical  variation  of  the  output  of  the  G.C.C.  This,  in  a  sense,  lumps 
the  "signal”,  c(r)*/?3,  (r),  variation  into  the  noise  terms  and  yields  the  H.B.  filter 

Wka  («) 

OO 

SNR, - ^ -  (18) 

-L  { 

2T  -oo 


Wff'B.  (w)  = 


G  n(w)G22(o;) 


(17) 


The  H.B.  is  similar  to  the  SCOT  introduced  by  Carter  et  al  [5]  in  that,  for 
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highly  dynamic  spectra,  in  addition  to  suppressing  the  cross-spectral  estimate  in 
o> regions  of  low  sign al-to- noise  ratio,  high  signal-to-noise  ratio  regions  are  also 
suppressed  in  an  attempt  to  reject  strong  tones  in  the  observations. 

Note  that  the  above  performance  criteria  impose  equal  penalties  on  small 
and  large  errors.  That  is  the  location  of  the  false  peak  in  the  GCC  output  exerts 
no  influence  on  the  signal-to-noise  ratios  defined  in  Eqns.  (11),  (14)  and  (16). 
Therefore  one  can  only  rely  on  these  criteria  if  the  signal-to-noise  ratio  is  suffi¬ 
ciently  high  to  guarantee  a  low  probability  of  large  error.  The  behavior  of  this 
probability  as  a  function  of  signal-to-noise  ratio,  observation  time  and  signal 
bandwidth  is  investigated  elsewhere  [7,13], 


HI.  The  Wiener  Processor 

Here  a  different  approach  is  taken  to  derive  an  optimal  filter.  We  deal 
directly  with  the  quantities  in  the  observation  time  domain  (i.e.  Fig.  1).  The  pro¬ 
cedure  is  motivated  by  the  following  argument.  If  we  knew  the  signal  s(t)  and 
the  filtered  version  s0  ( t )  exactly,  then,  from  the  linearity  of  the  phase  of  the 
channel,  the  time  delay  could  be  estimated  exactly  by  detecting  the  peak  of  the 
sample  cross- correlation  of  a(t )  and  $„(*).  Therefore  we  simply  try  to  estimate 
the  signal  s(f)  as  best  we  can  from  the  observations  x  t(t)  and  the  channel  output 
signal  s0  (<)  from  x2(t)  by  minimizing  the  mean  square  errors 

£{(*(0  ~  «(0)2}  =  min  (18) 

£{K  (0  ~  K  (0)2}  =  min  (19) 

where 

T 

«(<)=  /  x  x{a)h  x{t- a)d<7  (20) 

-T 
T 

*<,(<)  =  /  x2{a)h2{t-&)d<r  . 

-T 


(21) 


The  above  procedure  is  illustrated  in  Fig.  3.  Given  the  channel  characteristic 
C(u)  the  solutions  to  Eq.  (18)  and  (19)  are  the  Wiener  filters  H^u)  and  H2(u) 


H  iM  = 


G„(u)+Gnx4oJ) 


(22) 


H2(u)  = 


G„M|CM|2  +  Gm^u) 


(23) 


Noting  that  G  x2[u)  =  C[u)Gttf<jj)  we  can  express  the  above  filters  in  terms  of  the 
quantities  derived  from  the  observables 


#  iM  = 


i 

cm 


H  2(u)  —  C*{u) 


£  12(^1 

G  „(«) 
G  12M 
G22  (u) 


(24) 

(25) 


where  C*{oj)  is  the  complex  conjugate  of  C[u). 

With  these  filters  the  sample  cross-correlation  of  the  least  mean  square  error 
estimates  of  s(f)  and  s0  (/)  yields  the  estimate  of  the  cross  correlation  function 


RWFM  =  -k  /  A  (26) 

—00 

where 


S(u)  =  HiiujXrfu) 
S0  (u)  =  H2(u)X2(u) 


Regrouping  terms  in  (26)  we  obtain 


RWP{r)=X't  f  ^12M 


|G12« 


G\\(U)G  22M 


e}UTdu 


(27) 

(28) 


(29) 


Comparing  Eq.  (29)  with  Eq.  (6)  we  have  the  result  that  the  W.P.  is  equivalent 
to  using  a  Generalized  Cross-Correlator  with  the  filter  W(w)  equal  to  the  magni¬ 
tude  coherency  squared. 


It  should  be  emphasized  that  even  though  the  Wiener  filters  Hl  and  H2 
involve  the  knowledge  of  the  channel  C[u)  itself  the  G.C.C.  equivalent  processor 
does  not  impose  this  requirement.  In  fact,  as  far  as  the  cross-correlation  estimate 
of  time  delay  is  concerned,  the  actual  channel  is  immaterial  to  the  peak  detection 
procedure  in  the  cross-correlation  domain.  Hence  the  Wiener  filter  implementa¬ 
tion  (Fig.  3)  with  C(u>)  arbitrarily  set  to  unity  in  Eqns.  (24)  and  (25)  is  equivalent 
to  any  other  choice  of  C(w)  for  the  time  delay  estimation  problem. 

From  Eq.  (7)  the  variance  of  the  cross-spectrum  estimate  G12(u;)  is  propor¬ 
tional  to  the  product  of  the  auto-spectra  of  the  observations  G  ii(w)Cr  22(w)*  Fix 
the  sample  auto-correlation  Rsa  (r)  in  Eq.  (5).  Then  the  definition  of  "additive 
noise”  leading  to  the  signal-to-noise  ratio  SNR ,,  Eq.  (9),  yields  the  interpretation 
°f  1  -  buMI2  as  %  measure  of  the  cross-spectral  estimator  variance  about  the 
"desired  signal”  c(r)  *  R ^  (r).  Thus  the  W.P.  de-emphasizes  those  a>regions 
where  the  sample  cross-spectrum  is  likely  to  be  a  highly  inaccurate  estimate  of 
the  true  cross-spectrum.  This  is  not  surprising  given  the  raison  J  etre  of  the 
W.P.  which  is  to  estimate  accurately  the  smoothed  sample  auto-correlation, 
<t)*Rss  (r). 

The  W.P.  does  not  of  course  maximize  the  signal-to-noise  ratio  in  general. 
If  we  examine  the  optimal  processor  for  SNR1}  the  H.T.  (Eq.  (13)),  we  see  that  it 
has  the  additional  ability  to  overemphasize  as  well  as  to  de-emphasize  the  cross- 
spectral  estimate  according  to  the  function  -  b^MI2)-  (Actually  in 

[4]  the  above  function  is  shown  to  be  inversely  proportional  to  the  variance  of  the 
phase  estimate  G  i2(kO/|Gi2(w)|  with  respect  to  the  true  phase  of  the  cross- 
spectrum).  However,  in  situations  where  the  coherence  is  low,  and  the  signal 
spectrum  nearly  flat,  the  H.  T.  and  the  W.P.  are  virtually  identical  and  exhibit 
identical  performance  (Eq.  (13)  becomes  proportional  to  |-712|2). 
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It  is  also  observed  that  the  W.P.  is  equivalent  to  the  H.B.  for  nearly  flat  sig¬ 
nal  spectra  and  also  to  the  Eckart  if  we  add  a  low  signal-to-noise  ratio  condition 

1 


Wr.b.  (w)  = 


\GM\ 


|7i2MI2  = 


\GM\ 


Ww.p.  («) 


(30) 


Wek  (w)  = 


G ..  («) 


|7i2(w)|5 


(31) 


The  above  signal-to-noise  ratio  condition  is  that  G,t  (w)  be  uniformly  small  as 
compared  to  Gni(u)  and  Gn2(u). 


IV .  The  Robust  Wiener  Processor  For  Unknown  Spectra 

The  optimal  GCC’s  all  require  knowledge  of  the  signal  and  noise  spectra 
underlying  the  observations.  When  the  spectral  quantities  used  in  the  filter  func¬ 
tion  for  the  GCC  do  not  match  the  true  spectra  there  is  a  consequent  deteriora¬ 
tion  in  performance.  Two  approaches  to  the  problem  of  unknown  spectra  are  of 
interest.  We  either  estimate  the  spectra  and  substitute  the  estimates  into  the 
aforementioned  filters  (totally  unknown  spectra)  or  we  search  for  a  robust  solu¬ 
tion  over  a  range  of  spectra  perturbed  from  some  nominal  point  (partially  unk¬ 
nown  spectra). 

For  the  estimation  approach  the  sensitivity  of  the  GCC  filter  to  small  devia¬ 
tions  in  the  estimated  spectra  may  be  an  important  consideration.  As  applied  to 
the  H.T.,  the  substitution  method  yields  a  procedure  which  weights  the  phase  of 
the  sample  cross-spectrum,  G12(w),  with  the  function 

*  A  A 

Wff.r.  M  =  I  7i2(a;)|2/(1  _  I  7i2(w)|2)>  |  7i2(w)|2  a  magnitude  coherency  squared 
estimate.  A  simple  local  analysis  of  the  estimation  error  associated  with  WH  T 
yields  the  variance 


(1-  |7i2MI2)4 


var{  Wjj  -r  (a;)) 


var{  i  7i2MI2)  • 


(32) 
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W&r.  may  critically  underweight  the  phase  estimate  over  frequencies  where 
|712|2  is  high,  that  is  where  the  phase  estimate  is  apt  to  be  the  most  accurate. 
On  the  other  hand  substitution  of  |  712|2  for  the  W.P.  gives  only  as  much  error  as 
the  estimation  error  of  |  712|2  itself.  An  improved  filter  estimate  could  translate 
into  improved  performance  of  the  time  delay  estimate.  Naturally  these  comments 
must  be  verified  through  a  future  simulation  study. 

In  practice  the  spectra  may  be  only  partially  unknown  and  a  different  stra¬ 
tegy  can  be  used  to  design  the  GCC.  This  is  the  "robust”  approach  which  has 
been  applied  to  classical  matched  and  Wiener  filtering  with  some  success  [8-10]. 
The  resultant  filters  are  robust  in  the  maximin  sense,  e.g.  the  filter  maximizes  the 
minimum  output  signal-to-noise  ratio  as  the  spectra  are  allowed  to  vary  over 
their  regions  of  uncertainty.  Usually,  one  first  finds  the  signal  and  noise  spectral 
pair  which  gives  the  least  favorable  performance,  if  it  exists.  Then  one  optimizes 
the  filter  for  the  least  favorable  pair,  hence  the  name  maximin  filter.  For  a  pre¬ 
cise  formulation  of  the  robust  approach  see  [14]  and  [8-10]. 

To  our  knowledge,  no  results  are  known  concerning  the  solution  of  the 
robust  time  delay  estimation  problem.  Short  of  this  the  only  known  published 
result  in  maximin  filters  for  time  delay  is  that  of  Kassam  and  Hussaini  [11]  for 
the  pure  delay  case.  In  [11]  they  used  the  fact  that  the  Eckart  processor  maxim¬ 
izes  a  classically  defined  signal-to-noise  ratio  (See  Eq.  (14))  to  relate  the  filtering 
problem  to  robust  hypothesis  testing.  This  is  achievable  only  by  associating 
uncertainty  classes  with  the  spectral  product  Gni(u)Gnt{u),  rather  than  with  the 
individual  noise  spectra  themselves. 

For  the  pure  delay  channel  an  alternate  approach  to  combatting  against 
poor  performance  with  uncertain  spectra  is  suggested  by  the  recent  work  in 
robust  Wiener  filtering,  [8], [9],  when  applied  to  the  W.P.  With  regard  to  the  ori¬ 
ginal  formulation  of  the  W.P. ,  we  can  replace  the  least  mean  square  estimates  of 
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the  channel  input  and  the  channel  output  by  the  robust  least  mean  square  esti¬ 
mates  of  s(t)  and  s(t-D)  under  uncertainty  in  the  signal  and  noises.  Specifically 
we  assume  that  the  signal  spectrum  Gtt(u>)  belongs  to  the  spectral  class  {<r}, 
and  that  the  noise  spectra  £nj(u;)  and  Gn^u)  belong  to  the  spectral  classes 
and  {rj2}  respectively.  Then  we  solve  for  the  least  favorable  pairs  for  Wiener 
filtering  (G#(w)  ,  Gjf^u)}  and  {G,ift{u)  ,  G^{d)}  over  the  product  classes 
{<rX»7i}  aQd  {<tX »|2}  which  yield  the  robust  Wiener  filters  H f  and  H2  (see 
Eqns.  (2.3)  and  (2.4)).  Finally  we  implement  these  filters  in  the  cross-correlation 
domain  as  a  G.C.C.,  a  scheme  which  we  will  call  the  Robust  Wiener  Processor 
or  the  R.  W.P. 

V.  Numerical  Comparisons 

At  the  present  time  no  simulation  results  concerning  the  experimental  per¬ 
formance  of  the  W.P.  and  R.W.P.  as  opposed  to  the  other  G.C.C.’s  are  avail¬ 
able.  In  their  absence  a  preliminary  investigation  of  the  relative  merits  of  the 
above  processors  was  performed  based  on  the  various  signal-to-noise  ratio  criteria 
defined  in  Section  II,  for  some  specific  observation  spectra  and  for  the  pure  delay 
channel. 

Example  1 

Figs.  6  through  9  show  the  relative  performance  of  the  H.T.,H.B.,Eckart , 
SCOT,  and  C.C.  under  the  criteria  SNR  h  SNR2,  SNR3  and  local  variance, 
vari ,  of  the  time  delay  estimate  (3),  for  a  third  order  Markov  signal  in  first  order 
Markov  noises  with  the  noise  3dB  bandwidth  a  factor  of  ten  greater  than  that  of 
the  signal  (see  Figs.  4  and  5).  These  spectra  were  chosen  for  their  tail  behavior  to 
avoid  certain  degeneracies  in  the  local  variance  criterion.  The  interesting  thing 
to  note  is  that  under  SNR  j  and  SNR2  the  W.P.  exhibits  better  performance 
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than  all  of  the  other  sub-optimum  G.C.C.’s  for  that  particular  definition  of  SNR. 
Under  SNRZ  it  is  a  close  second  next  to  the  M.L.E.  In  fact,  under  the  criterion 
SNR !,  performance  of  the  W.P.  is  virtually  identical  to  the  optimal  H.  T.  proces¬ 
sor.  Although  the  local  variance  ranks  the  W.P.  behind  the  H.T.,  H.B.  and 
Eckart  (see  Fig.  9),  it  only  marginally  disfavors  the  W.P.  at  low  signal-to-noise 
ratios  (In  Fig.  9  the  SCOT  and  C.C.  processors  have  orders  of  magnitude  worse 
performance  than  the  W.P.  and  are  off  scale). 

Example  2 

Here  the  performance  of  the  R.W.P.,  W.P.  and  other  G.C.C.’s  are  compared 
using  SNR  j  for  the  e-contaminated  uncertainty  class  on  the  specific  spectra  in 
the  example  outlined  in  Kassam  and  Lim’s  paper  on  Robust  Wiener  filtering  [9]. 
Specifically,  under  the  nominal  assumption  ,  at  each  sensor  we  have  a  signal  with 
the  flat  bandlimited  spectrum  G,°t  (a;)  in  first  order  Markov  noise  with  the  spec¬ 
trum  Gn°(uj),  where  the  signal  and  noises  are  of  comparable  bandwidths  (see 
Figs.  10  and  11).  The  uncertainty  on  the  signal  and  noise  spectra  are  modeled  as 
the  €- mixtures 

(l-€i)G,*  (w)  +  e1G„  (a;)  (33) 

and 

(l-e2)G'n',(a;)  +  e2Gn  (oj)  (34) 

respectively  with  G,'t  (w)  and  Gn'  (w)  arbitrary  spectra  having  the  same  mass  as 
the  nominal  and  and  e2  lying  in  the  interval  [0,1].  When  ex  =  0.2  and 
e2  =  0.1  the  least  favorable  signal  and  noise  spectra  are  plotted  in  Figs.  12  and 
13  respectively.  This  corresponds  to  the  case  where  one  may  have  more  confi¬ 
dence  in  the  nominal  noise  than  in  the  nominal  signal.  The  least  favorable  spec¬ 
tra  for  this  example  illustrate  a  typical  attribute  of  least  favorables  in  that  the 
worst  performance  of  a  Wiener  filter  occurs  when  the  signal  masquerades  as  the 
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noise  and  vice-versa,  i.e.  when  we  get  a  minimum  separation  of  hypotheses  con¬ 
cerning  the  presence  or  absence  of  the  signal  within  the  uncertainty  classes  (33) 
and  (34).  Fig.  14  shows  the  relative  performance  for  the  nominal  spectra  and 
Fig.  15  the  performance  for  the  least  favorable  signal  and  noise  spectra  for 
Wiener  filtering.  Looking  at  the  nominal  case  we  note  that  the  use  of  the 
R.W.P.  entails  a  loss  of  about  3dB  at  low  SNR  (below  about  Odb)  over  the 
optimal  for  the  least  favorable  pair.  However  when  the  true  signal  and  noise 
spectra  are  least  favorable  for  Wiener  filtering  the  R.W.P.  displays  uniformly 
better  relative  performance,  gaining  about  3db  over  the  other  processors  at  low 
signal-to-noise  ratios.  Note  that  the  pair  in  Figs.  12  and  13  is  not  necessarily  the 
least  favorable  pair  for  H.T.  filtering  so  that  no  conclusive  result  is  indicated 
here.  However,  Fig.  15  does  suggest  that,  at  least  for  some  spectra  in  the  above 
uncertainty  class,  we  can  expect  better  performance  with  the  R.  W.P.  than  with 
the  optimal  scheme  for  the  nominal  spectra.  Therefore  the  WP  and  RWP  instru¬ 
mentations  may  be  viable  alternatives  to  existing  time  delay  estimation  schemes. 
However,  experimental  investigations  of  these  advantages  will  prove  to  be  the 
ultimate  yardstick  of  performance. 
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Fig.  3:  GCC  implemented  as  two  prefilters  H and  Hz{^) 
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Third  order  Markov  signal  spectrum  for  Ex.  1 


Fig.  4 


First  order  Markov  noise  spectrum  for  Ex.  1 


Fig.  5 


OUTPUT  SNR  (dB)  OUTPUT  SNR  (dB) 


23 


Performance  of  various  processors  under  SNRl 


Fig.  7 
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Performance  of  various  processors  under  SNE3 


Local  variance  for  various  processors 


Fig.  9 
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Nominal  signal  spectrum  for  Ex.  2 


Fig.  10 


Nominal  noise  spectrum  for  Ex.  2 


Fig.  11 
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Least  favorable  signal  spectrum  for  Ex.  2 


Fig.  12 


Least  favorable  noise  spectrum  for  Ex.  2 


Fig.  13 
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SNR  i  at  the  nominal  spectra 


Fig.  14 


SNR i  at  least  favorable  spectra 
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Chapter  3 

The  Center  of  Symmetry  Estimator  for  Time  Delay 
I.  Introduction 

In  the  previous  chapter,  the  Generalized  Cross  Correlator  (GCC)  estimate  of 
time  delay,  given  by  the  location  in  time  of  the  global  peak  of  the  GCC  output 
trajectory,  was  motivated  from  a  SNR  point  of  view.  In  fact,  the  Maximum 
Likelihood  Estimator  (MLE)  of  the  time  delay  is  implementable  as  a  GCC,  the 
Hannan-Thomson  processor  (HT),  for  the  observation  model  (1)  in  Chapter  2  and 
sufficiently  large  observation  time..  It  is  well  known  that,  under  broad  conditions, 
the  MLE  asymptotically  achieves  minimum  variance  over  all  unbiased  estimators. 
Hence,  in  the  limit  of  large  observation  time,  the  GCC  family,  and  specifically 
the  HT,  has  a  strong  claim  to  supremacy  over  other  methods.  However,  for  finite 
observation  time,  the  MLE  can  only  be  said  to  achieve  a  minimum  local  variance; 
that  is,  when  the  variation  in  the  estimate  is  such  that  it  is  highly  unlikely  to  fall 
outside  of  the  immediate  vicinity  of  the  true  delay  at  the  global  maximum.  This 
assumption  is  especially  tenuous  when  the  spectra  of  the  observations  contain  a 
narrowband  component  [2]. 

In  this  chapter  an  alternate  estimation  scheme  is  presented  which,  by  design, 
takes  into  account  non-local  error  and  appears  to  be  less  sensitive  to  narrowband 
components.  The  idea  is  to  substitute  a  center  of  symmetry  estimate  (CSE)  of 
the  cross-correlation  function  in  place  of  the  global  peak  estimate  used  in  the 
conventional  GCC.  A  general  procedure  is  introduced  which  minimizes  the 
energy  in  the  asymmetric  component  of  the  GCC  over  an  a  priori  known  region 
of  time  delay.  This  is  done  by  looking  at  the  coefficients  in  a  generalized  Fourier 
expansion  of  the  GCC  trajectory.  In  particular,  the  Walsh  expansion  yields  sim¬ 
ple  procedures  for  estimating  symmetry,  the  Local  Center  of  Symmetry  Estimate 
(LCSE),  which  operates  on  the  GCC  trajectory,  and  the  Modulus  CSE  (MCSE), 


-  29- 


which  acts  on  the  absolute  magnitude  of  the  GCC  waveform.  After  deriving  an 
approximate  expression  for  the  variance  of  the  LCSE,  for  a  general  filtered  sam¬ 
ple  cross-correlation  function,  the  filter  is  optimized  to  give  minimum  local  vari¬ 
ance  and  is  compared  to  the  MLE.  The  optimal  filter  takes  the  form  of  a  simple 
"matched  filter”  when  the  observation  time  is  sufficiently  large.  The  local  vari¬ 
ance  of  the  MCSE  is  then  derived  for  the  case  where  the  second  order  distribu¬ 
tions  of  the  GCC  trajectory  are  known. 

Simulation  results  for  narrowband  spectra  are  next  presented  which  indicate 
that,  for  the  case  considered  here,  the  optimal  LCSE  has  better  large  error  perfor¬ 
mance,  as  compared  to  two  popular  representatives  of  the  GCC  class,  the  HT 
and  the  SCOT. 

The  chapter  is  organized  as  follows.  First  the  problem  is  stated  and  the  dif¬ 
ficulty  alluded  to  above  is  described  when  the  conventional  optimal  processor  is 
used.  We  then  present  the  alternate  procedures  .  A  small  error  approximation  to 
the  variance  of  the  LCSE  and  MCSE  estimates  is  developed  analogously  to  [3]. 
Optimization  of- the  CSE  weighting  is  performed  for  the  LCSE  based  on  the  local 
variance  approximation  and  a  comparison  of  the  local  variance  of  the  optimal 
GCC  versus  the  LCSE  estimator  is  undertaken.  Based  on  the  local  variance 
expression  a  simple  example  is  presented  illustrating  the  difference  in  estimation 
philosophy  between  the  GCC  and  the  LCSE.  Finally  the  results  of  a  simulation 
of  the  CSE  scheme  against  the  two  GCC  processors  are  discussed. 

II.  Problem  Statement 

As  in  Chapter  2,  two  Gaussian  wide  sense  stationary  processes  x  \(t)  and 
x2(t)  are  observed  over  a  time  interval  [0,T].  However,  here  it  is  assumed  that 
the  intersensor  transfer  characteristic  is  pure  delay,  so  that  |C{u;)|  =  1  in  (1)  of 
Chapter  2.  In  other  words,  Zj(f)  and  x2(t)  are  assumed  to  be  of  the  form 
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*1(0  =  40  +  »i(0 

x2(t)  =  4t  -D0)  +  n2(t) 


(1) 


(Note  the  slight  change  in  notation  from  Chapter  2  for  the  delay  parameter). 


Here  s(t)  is  a  random  signal  with  an  autocorrelation  function  Rtl{r)  which  falls 
off  to  zero  for  r  greater  than  Te ,  the  correlation  time  of  the  signal.  The  noises 
nx(f)  and  n2(t)  are  uncorrelated  and  are  taken  as  broadband  with  respect  to  s(t). 
Again  assume  that  the  sensor  observation  time,  T,  is  much  greater  than  both  Te 
and  the  maximum  a  priori  deviation  of  D0 ,  Dm  . 

The  GCC  estimate  of  time  delay  is,  as  before,  obtained  from  the  global  max¬ 
imum  over  \-Dm  ,Dm  ]  of  a  suitably  filtered  sample  cross-correlation  function 
(Here  we  assume  coherent  cross-correlation  estimates  are  used).  However,  for 
notational  purposes,  we  will  specifically  denote  the  GCC  estimate  as  DGCC  to 
distinguish  it  from  the  other  estimates  introduced  in  this  chapter.  G  12(  w)  is  the 
sample  cross-spectrum  obtained  by  Fourier  transforming  the  sample  cross- 
correlation  R  12(r).  The  defining  relations  for  the  GCC  trajectory  and  the  associ¬ 
ated  peak  estimate  of  delay  are  repeated  from  Chapter  2 


OO 


=  j  Gl2(w)W[w)e:v>rdw  t£[-T,  T] 


-OO 


(2) 


For  the  discussion  to  follow  we  will  need  to  define  the  quantity  Te'  as  the 
smallest  number  such  that  for  a  given  a  close  to  zero 


I*.;  Ml  - 1  J-  /  ICisMI  t*w«*"*>  I  <  a 

— OO 

M  >  Te’ 


(3) 


Te'  is  interpreted  as  the  a-correlation  time  of  the  filtered  process 


s(t)  *  u>+(f) 
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00 

«,+(*)  =  -L  f  W+{w)eivt  dw 
2jr  -00 

and  W+(w)  has  all  of  its  poles  in  the  LHP. 

W[w)=  W+(u;)(  W +(«;))  * 

Under  an  asumption  of  sufficiently  large  observation  time,  the  MLE,  for  the 
unknown  delay  D0 ,  takes  the  form  of  a  GCC  implemented  with  the  HT  weight 
(Eq.  (13)  of  Chapter  2)  (1).  This  GCC  has  also  been  shown  to  minimize  the  local 
(small  error)  variance  of  any  GCC  estimate  of  delay  [6].  Therefore,  the  HT  will 
outperform  any  other  estimator  for  sufficiently  large  observation  time,  and  will 
locally  outperform  any  other  GCC. 

The  local  variance  is  a  measure  which  is  only  sensitive  to  "small  errors”;  it 
characterizes  estimator  performance  for  high  signal-to-noise  ratio  in  the  immedi¬ 
ate  region  of  the  true  delay  D0 .  However,  it  significantly  underestimates  the 
actual  variance  when  the  global  peak  is  likely  to  be  far  removed  from  D0 ,  as  can 
occur  for  even  moderately  high  signal-to-noise  ratio  and  narrowband  signals  using 
the  HT  [2).  Thus  the  optimality  of  the  HT  can  only  be  asserted  in  a  small  error 
sense.  The  maximum  value  of  the  trajectory  of  the  HT  is  in  general  highly 
unstable  in  the  sense  that  small  variations  in  signal-to-noise  ratio  can  translate 
into  large  and  abrupt  changes  in  the  location  of  the  absolute  maximum  (e.g. 
waveforms  in  Fig.  2.1  and  2.2).  This  discontinuous  behavior  of  the  estimate  is 
characteristic  of  GCC’s  in  general  due  to  the  peak  detection  based  estimation 
procedure.  It  is  this  undesirable  property  of  peak  detection  oriented  time  delay 
estimation  schemes  that  motivates  the  subject  of  this  chapter. 
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m.  Center  of  Symmetry  Estimates 

GCC  type  processors  can  be  interpreted  as  estimators  which  utilize  the  pro¬ 
perty  that,  asymptotically,  the  cross-correlation  function  assumes  its  absolute 
maximum  at  the  true  time  delay  D0 .  Here  we  exploit  a  different  asymptotic  pro¬ 
perty  of  the  cross-correlation  to  motivate  another  approach:  the  delay  D0  occurs 
at  the  center  of  symmetry  of  the  cross-correlation  function.  Essentially  the  esti¬ 
mation  method  involves  extracting  the  asymmetric  component  of  R  3  about  each 
candidate  point  D  in  the  a  priori  region.  Then  the  center  of  symmetry  estimate 
is  set  to  that  point  which  minimizes  the  energy  in  this  asymmetric  component. 
The  general  procedure  for  estimating  the  center  of  symmetry  is  stated  below. 

Let  {Ek  (r),  Ok  (r)}  be  a  complete  orthonormal  set  of  functions  on  an  interval 
[-L,  L].  Here  the  Ek ’s  are  even  and  the  Ok ’s  are  odd  about  the  origin.  We  now 
expand  R 1  in  a  Fourier  series  over  the  length  2 L  interval  centered  at  D, 
[D-L,  D+L ] 

00  A  A  00  A 

Ri(T)  =  E  eiiD)Ei{T-D)  +  E  °;(D)0;(t-D)  (4) 

i— i  i—i 

Where  we  have  defined  the  Fourier  coefficients  ek  (D),  ok{D)  of  R  g  correspond¬ 
ing  to  Ek  ( t-D ),  Ok  ( r-D ) 

D+L 

et(D)=  J  R  g  {r)Ek  (T-D)dT 

D-L 

(5) 

D+L 

ok(D)=  f  R'(T)Ok(T-D)dT 

D-L 

Now  the  first  and  second  terms  to  the  right  of  the  equality  in  Eq.  (4)  represent 
the  even  and  odd  components  of  R 1  about  the  point  D.  Because  of  the  orthonor¬ 
mality  of  the  expansion  functions,  minimimizing  the  energy  in  the  odd  com¬ 
ponent  over  D  E  \-Dm  ,Dm  }  is  equivalent  to  minimizing  the  sum  of  the  squares  of 
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the  0;  (D).  For  practical  purposes  we  minimize  only  the  N-th  partial  sum  of  the 
squares  of  the  odd  Fourier  coefficients  to  give  the  center  of  symmetry  estimate 

N 

Dcse  —  .  argmin  £  |o,-  (Z>)|2  (6) 

As  stated  above  the  Center  of  Symmetry  Estimate  depends  on  quite  a  few 
free  parameters:  the  set  of  orthonormal  functions  {Ek  ,  Ok  };  the  "window  length” 
2 L\  the  truncation  parameter  N  and  the  specific  GCC  weighting  employed  W(w). 
In  principle  one  could  select  the  orthonormal  functions  such  that  the  symmetry 
information  is  concentrated  in  the  first  few  terms  of  the  Fourier  series.  L  should 
be  chosen  to  minimize  the  multiplicity  of  the  local  minima  of  the  N-th  partial 
sum  in  Eq.  (6)  in  order  to  maximize  the  resolution  of  the  CSE  procedure. 

Here  a  specific  implementation  of  the  CSE  will  be  analyzed  and  evaluated. 
This  corresponds  to  choosing  the  Walsh  functions  over  the  window  [-L,  L]  as  the 
orthonormal  set.  The  first  three  of  these  functions  are  shown  in  Figs.  3.1  a,b  and 
c.  As  a  particularly  simple  case  we  use  only  the  first  odd  Walsh  function  in  the 
family,  Fig.  3.1b,  to  form  the  CSE.  That  is  we  take  N  equal  to  one  in  Eq.  (6). 
The  procedure  then  only  involves  evaluating  the  simple  statistic 

D+L 

°i =  TF  /  Rg  iT)sgn{r-D) dr  (7) 

2L  D-L 

Since  the  normalization  by  2 L  has  no  effect  on  the  location  of  the  minima  of  o  j 
we  will  often  omit  it.  This  particular  CSE,  which  we  will  call  the  Local  Center  of 
Symmetry  Estimate  (  LCSE),  merely  takes  the  center  of  symmetry  as  that  point, 
Dcse  ,  which  divides  the  area  under  R  9  to  the  left  and  right  of  DCSE  into  two 
equal  parts.  However  due  to  the  truncation  of  the  infinite  sum  in  Eq.  (5)  to  a 
single  term  in  Eq.  (6)  the  general  CSE  procedure  must  be  modified  to  take  into 
account  further  properties  of  R  ?  at  its  center  of  symmetry,  namely  that  there  is 
a  global  maximum  there  for  large  SNR.  The  actual  procedure  proposed  uses  the 
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estimate 

.  (  median  of  the  upcrossings 

Dcse  —  |  of  o  i  within  [-Z>m  ,  Dm  ]  ^ 

An  upcrossing  of  o  j  is  defined  as  a  point  where  o  j(r)  changes  sign  from  negative 
to  positive  as  r  increases.  The  median  of  a  monotonic  sequence  y1(  y  2»  •  •  >  Vn  i® 

defined  to  be  y  n  for  n  even  and  yB+1  for  n  odd. 

T  +1  2 

In  regard  to  Eq.  (8)  refer  to  Fig.  3.2.  The  plausibility  of  the  estimate  is  made 
clear  by  the  following.  If  Rg  has  a  local  maximum  at  its  center  of  symmetry 
then  o  j(r)  will  upcross  the  origin  there  since  the  area  identified  with  ”+” 
becomes  greater  than  that  identified  with  the  in  Fig.  3.2.  In  the  case  where 
R  9  is  everywhere  non-negative  in  the  integration  window  and  L  is  such  that  , 
asymptotically,  Rg{r)  is  concentrated  in  [D-L,  D+L]  for  all  D£[-Dm,Dm], 
(e.g.  L  >  Te'  +  Dm  ),  o  ^t)  gives  a  unique  zero  converging  to  Da  .  We  are  more 
interested  in  the  case  where  the  left  and  right  tails  of  R  *  do  not  significantly  fall 
outside  of  the  leftmost  and  rightmost  integration  windows  \-Dm  -L  -Dm  +L]  and 
[Dm-L,Dm+L]  respectively  (  See  Fig.  3.2  ).  In  this  case  multiple  upcrossings 
occur  in  o  v  However,  asymptotically,  they  are  at  locations  which  are  symmetric 
about  the  center  of  symmetry  of  R g .  Thus  the  median  picks  out  the  correct 
zero  location  of  Eq.  (7)  corresponding  to  the  true  delay. 

In  principle  the  window  parameter  L  can  be  chosen  to  optimize  the  theoreti¬ 
cal  and/or  practical  performance  of  the  estimate.  Indeed  in  the  limit  as  L 
becomes  small,  L  =  A  say,  the  LCSE  can  be  looked  at  as  a  generalization  of  a 
peak  discriminator,  i.e.  a  GCC,  by  noting  that,  within  a  scale  factor,  we  have 
from  Eq.  (7)  (by  the  mean  value  theorem) 

oM - s— i - 1 - jt 


(9) 
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Hence,  for  asymptotically  small  L,  o  i(r)  upcrosses  zero  wherever  there  is  a  local 
peak  of  R  }  ,  obviously  not  a  good  attribute  for  our  purposes.  On  the  other  hand 
if  the  maximum  admissible  deviation  of  Dg  from  zero,  Dm ,  is  such  that 
Dm  +  Te  <  T  then  one  can  integrate  over  the  majority  of  the  positive  extent  of 
the  normalized  R  9  by  setting  L  —  Te'  .  This  choice  should  yield  a  statistic,  o  1( 
which  has  the  least  chance  of  getting  hung  up  on  a  local  maximum  of  R g . 

In  view  of  the  effect  of  multiple  zeros  on  the  LOSE  discussed  above  it  would 
be  to  our  advantage  to  achieve  a  reduction  in  the  number  of  zero  upcrossing  solu¬ 
tions  to  Eqns.  (6)  or  (7).  This  suggests  the  application  of  the  asymmetric  com¬ 
ponent  minimization,  described  above,  to  the  absolute  value  of  the  GCC  output 
trajectory.  For  definiteness  we  will  concentrate  on  the  LOSE  procedure  applied 
to  the  modulus  of  R 9 .  This  estimate,  denoted  the  MCSE,  is  obtained  by  finding 
the  median  of  the  locations  of  the  zero  upcrossings  within  \-Dm  ,  Dm  ]  of 

D+L 

»"(£)  =  -A-  /  I  R’  (<T)  I  m(T-D)iT  (10) 

iL  D-L 

Note  that  for  all  of  the  above  CSE  methods,  unlike  the  GCC  estimates,  a 
small  random  change  in  the  detailed  structure  of  R  3  will  not  translate  into  large 
deviations  of  DCSE ,  since  only  large  changes  in  the  area  under  R  3  (r),  r  >  D0  or 
R  g  (t),  r  <  D„  can  significantly  change  the  location  of  a  zero  of  o  j(r)  or  o  ^(r). 
This  can  be  attributed  to  the  fact  that  the  CSE  essentially  smooths  out  spurious 
peaks  in  R  9  .  The  next  section  is  concerned  with  the  local  or  small  error  proper¬ 
ties  of  the  LCSE  and  MCSE  families  considered  here.  Based  on  these  properties 
the  optimal  GCC  weighting,  W( w),  for  the  LCSE,  is  then  derived. 

IV .  Theoretical  Performance  of  the  CSE 

Throughout  the  following  we  will  assume  the  following  for  the  LCSE  and 
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MCSE  and  Dm  the  maximum  a  priori  deviation  of  D0  from  zero:  1) 
Te'  «  L  «  T\  and  2)  Dm  +L  «  T.  Assumption  1  and  2  essentially  con¬ 
strain  the  filter  VV(uj)  not  to  overly  distort  the  spectrum  |C12(u>)|  so  that  the 
majority  of  the  non- zero  range  of  the  mean  GCC  trajectory  always  lies  within  the 
integration  window. 

Assuming  consistent  estimates  of  G  l2{w),  the  GCC  trajectory  R3(r)  will 
converge  to  the  filtered  signal  autocorrelation  R„  (r)  *  w(r),  which  is  symmetric 
about  D0 ,  as  T  -*  oo.  Thus  by  assumptions  1  and  2,  o  j(r)  and  o  ^(r),  (Eqns.  (7) 
and  (10))  will  display  zeros  symmetrically  located  about  r=D0,  which  implies 
that  the  CSE  methods  are  asymptotically  locally,  unbiased. 

For  comparison  purposes,  we  will  derive  the  local  variance  of  the  CSE  esti¬ 
mators  under  analogous  small  error  assumptions  used  elsewhere  for  the  derivation 
of  the  local  variance  of  the  GCC  [3], [5].  Then  the  resulting  expression  will  be 
compared  to  that  of  the  GCC  in  the  case  of  the  LCSE.  Finally  an  asymptotic 
approximation  to  the  optimal  GCC  weight  in  terms  of  LCSE  variance  will  be 
presented. 

For  simplicity  we  let  o  x(r)  represent  the  two  CSE  statistics  for  the  LCSE, 
Eq.  (7),  and  the  MCSE,  Eq.  (9).  We  use  essentially  the  same  idea  to  derive  the 
local  variance  as  in  reference  [5].  Define  the  mean  value  of  o  ^r), 
Oj(r)  =  E[o  1(<r)J  |  ^  ^  r  Now  expand  o  x{r)  in  a  Taylor  series  about  Dg  retaining 
only  the  linear  term  explicitly 

do  ADA 

o  i(r)  =  o  X(D0 )  +  ( t-D0  )  — ^ -  +  o{t-D0  )  (11) 

Note  that  o  X{D0 )  =  0. 

Assume  that  o  j(r)  crosses  through  zero  at  r  =  D  and  that  D  lies  in  the  linear 
region  about  D0  of  o^r),  which  will  be  referred  to  as  the  local  error  region,  RL 
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A  A 

(See  Fig  4.1).  That  is  D-Da  is  small  enough  so  that  o(D-D0 )  terms  in  Eqn  (11) 
can  be  neglected.  Take  the  variance  of  both  sides  of  Eq.  (11)  to  obtain 

2 

(12) 


var[o  j(D)]  =  var[D ] 


do  X{D. ) 
dDn 


Now  as  a  small  error  approximation,  the  deviation  of  ox(D)  for  D  £  Rl  i3  ident¬ 
ical  to  the  deviation  of  o  t(r)  at  t=  D0  over  the  realizations  of  o  t(r)  having  local 
zero  upcrossings  (see  Fig.  4.1).  Hence,  we  obtain  for  the  local  variance  of  D 


varL  ( D ]  = 


var[o  X{D0 )] 


(13) 


which  is  analogous  to  the  expression  obtained  for  the  local  variance  of  the  GCC 
estimate  [5]  . 


vai\D<3cc\  — 


dR*(D0)  \ 
dD0  i 


J  d2R’(Da) 

|  dD02 


(14) 


The  denominator  of  (13)  is  simply  computed 

j;  o.Wl-A  =2R>(D.)-R’(D,+L)-R'(D,-L)  (15) 

Since  R  3  (t)  is  a  locally  unbiased  estimator  of  R„  (r)  *  w(t)  \  Tsmt_pt  which  is  sym¬ 
metric  about  D0 

E{  -^T  0  i(r)  I  r— £>.}  =  [2#„  (r)  *  w(r)  -  2 R„  (r-L)  *  u<r-L)]  |  (16) 

By  assumption  L  »  Te'  so  that  the  second  term  in  brackets  in  Eq.  (15)  is 
approximately  zero.  Thus  the  denominator  of  Eq.  (13)  becomes  in  the  frequency 
domain 
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e{£  0iWUb.}=7  /  I  g12(«.)|  W[w)dw  (17) 

Even  though  we  wish  to  apply  the  CSE  procedure  to  narrowband  signals,  for 
the  derivation  of  the  local  variance  it  is  necessary  to  assume  a  large  time- 
bandwidth  product.  The  resulting  expression  will  be  seen,  however,  to  well 
characterize  the  performance  of  the  CSE  even  for  narrowband  signal  spectra. 
Under  these  assumptions,  R3(t)  is  approximately  covariance  stationary  for 
r  D0  (See  Appendix  C).  Define  <r(r, v),  the  covariance  function  of  R  3  (r)  and 
R3  (v),  and  the  GCC  spectrum,  C[w).  var[o  X{D0)\  is  computed  in  Appendix  A 
for  the  LCSE.  For  large  values  of  L  the  variance  of  the  LCSE  has  the  approxi¬ 
mate  form 


varL  [D\ 


L_ 

2 


qo)i  mo)i2 

oo 

—  /  I  G  12(u;)  |  dw 
*  -00 


(18) 


An  expression  is  derived  in  Appendix  C  for  C[w),  Eqn  (C.4),  which  is,  for  w  =  0 

qo)  =  i  |  mo)I2(g„(o)<jS2(»)  +  |c,s(o)|2)  (i») 


where  k  is  directly  proportional  to  T,  the  observation  interval.  Substituting  (19) 
into  (18)  and  recalling  the  definition  of  the  coherency 

A  L  G11(0)(722(0)(l  +  h12(0)|2)|Vn0)|2 
variD  =  lk  — ] - - - 7- —  (20) 

—  /  I  Gl2{w)  |  W{w)  dw 

T  -00 


Note  that  since  L  is  a  fixed  constant  in  Eq.  (20)  the  LCSE  estimate  is  consistent 
since  k  — ►  oo  as  T  — ►  oo. 

If  the  two  dimensional  distributions  of  R 3  are  known  then  the  local  vari¬ 
ance  of  the  MSCE  can  be  derived  (See  Appendix  B).  Define 
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¥,(«)  =  E{e,,J?'W} 
$ti,(u)  =  E{c,'oi?'Wi?,W} 


0° 

*4** T)  =  —  /  ~V  *tAu)du 

X  -oo  « 

1  00  1  00 

—  /  — T  *t(u)du  -7  /  ~T  *Au)du 


X  -CO  « 


4o  «2 


The  function  i^r,  <r)  is  the  covariance  function  between  |  Rg  {t)  |  and  |  Rg  (cr)  |. 
Substituting  Eq.  (B.32)  in  Eq.  (13)  we  obtain  for  the  local  variance  of  the  MCSE 


f  dr  f  d<r  iAj,  a) 

varL  D  =  - - - - - - j  (21) 

0O 

7  /  ”7  *D0(u)du 

*  -co  U2 


where  f  denotes  the  difference  of  the  two  integral  operators 

c 

Do  Dt  +L 

/  -  / 

D9  —L  D  0 


(22) 


Without  further  assumptions  on  the  distribution  of  the  GCC  trajectory,  Eq.  (21) 
is  too  general  to  be  useful  in  indicating  the  performance  of  MCSE. 

For  comparison  we  display  the  expression  derived  in  [5]  for  the  GCC  estima¬ 
tor  variance 


/  w2G?11(tu)G22(u;)(l-|712(u))|2)  |  W[w)\2dw 
*  1  ^  00 

varL  Dgcc  =  —  - : - - - 2 - 

00 

/  M>2|G12(tr)|  W{i v)dw 


(23) 


The  quantity  G  11(w)C22(u;)(l  -  |  712(u>)  I  2)  I  VV(tt;)  |  2  can  be  interpreted  as  the 
spectral  density  of  the  component  of  Rg  which  corrupts  the  global  peak  at  D0 . 
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This  is  the  correlator  noise  in  the  representation,  (3)  of  Chapter  2,  of  the  GCC 
output.  Comparing  the  numerators  of  (20)  and  (23),  it  is  evident  that  the  vari¬ 
ance  of  the  LCSE  depends  on  the  correlator  noise  variance  only  through  the 
value  of  its  spectrum  in  the  immediate  neighborhood  of  in  =  0,  while  for  the 
GCC  it  varies  as  the  second  moment  of  the  noise  spectrum.  This  reflects  the 
time  averaging  criterion  which  forms  the  crux  of  the  center  of  symmetry  esti¬ 
mate.  In  other  words,  only  the  average  value  of  R  g  (r)  to  the  left  and  right  of 
t  =  D  are  utilized  by  o  j (r)  in  its  search  for  a  zero.  The  above  comments  imply 
that  the  (local)  variance  of  the  LCSE  will  be  insensitive  to  changes  in  the 
detailed,  i.e.  high  frequency,  structure  of  the  noise  spectra  as  long  as  the  average, 
or  D.C.,  power  remains  the  same.  Thus  a  certain  robustness  to  the  underlying 
noise  in  the  observations  is  indicated. 

Eq.  (20)  is  a  limiting  form  of  the  actual  expression  for  the  LCSE  variance 
derived  in  Appendix  A.  In  so  far  as  the  actual  performance  is  well  characterized 
by  this  asymptotic  expression,  it  is  clear  that  any  weighting  function  W{w)  pos¬ 
sessing  a  null  (infinite  attenuation)  at  in  =  0  is  optimal  for  the  LCSE  class  as 
long  as  the  denominator  of  Eq.  (20)  is  finite,  i.e.  W{w)  does  not  annhilate  the  sig¬ 
nal  spectrum  G„  (in).  In  particular  a  modified  simple  cross-correlator:  W[w)  —  0 
if  Gtt  (w)  =  0  or  if  w  =  0,  W{w)  =  1  otherwise,  would  satisfy  the  optimality 
condition  mentioned  above. 

The  above  simple  optimizing  weight  arises  from  consideration  of  Eq.  (20).  A 
more  accurate  expression  for  the  LCSE  variance  is  given  in  Appendix  A,  Eq. 
(A.ll).  Using  Eq.  (A.11)  an  optimal  W,  within  the  class  of  integrable  frequency 
functions  continuous  at  the  origin,  in  =  0,  can  be  derived  for  large  L  and  the 
additional  assumption  of  smooth  C(in).  It  has  the  form 

gM(«>) 

1  +  C[w)8i  (in) 


W[w)  = 


(24) 
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where 

6l  (to)  =  2Lsine\Lw)  (25) 

The  filter  W[w)  of  Eq.  (24)  is  derived  using  the  observation  that,  for  sufficiently 
large  L,  6^  («;)  is  either  less  than  e  or  larger  than  1/e  except  over  frequency  inter¬ 
vals  with  aggregate  length  less  than  2/VeL.  In  [7,  Appendix  D]  this  is  shown  to 

imply  that  the  numerator  of  the  local  variance  expression,  (A.11),  can  be  replaced 

00 

by  kj  (1+C(w)6l  (u>))|  W{w)\dw  with  only  a  small  error.  For  L  very  large,  SL  in 

-00 

Eq.  (24)  is  essentially  zero  over  all  frequency  except  in  the  neighborhood  of  the 
origin.  We  will  investigate  the  performance  of  the  limiting  form  of  Eq.  (24) 

m®)  =<?„(»)  (26) 

where  we  have  neglected  the  notch  at  w  =  0  of  Eq.  (24).  The  filter  in  (26)  is 
matched  to  the  spectrum  of  the  signal.  For  convenience,  we  shall  refer  to  it  as  a 
matched  filter.  This  does  not  define  a  matched  filter  m  the  conventional  sense 
since  the  signal  is  non-deterministic  and  no  prewhitening  is  employed. 

The  two  "optimal”  procedures  mentioned  above  will  be  investigated  in  the 
this  paper.  One,  W(u>)  =  1  over  the  region  supporting  G„  (w),  will  be  referred  to 
as  the  cross-correlator  (CC)  and  the  other,  given  by  Eq.  (26),  the  matched  filter 
(MF)  versions  of  the  LOSE,  or  the  CC-LCSE  and  MF-LCSE  respectively.  We 
now  present  a  simple  example  for  the  optimal  LOSE  in  the  case  where  the  obser¬ 
vations  have  flat  spectra. 

Assume  the  signal  and  noise  spectra  are  fiat  and  strictly  bandlimited 

<?„(»)  =  S  %  I  «  I  <  S/2 

=  0  |  w  |  >  B/  2 

<?..•(»)  =  w-jr-  M  <  S,/2  (27) 

I  W  |  >  Bn  /2 


0 


For  the  above  case  the  CC-LCSE  and  the  MF-LCSE  give  identical  local  variance 
expressions.  An  optimal  weight  is  thus  W(u;)  =  1  within  the  non-zero  region  of 
G„  («;)  and  W{w)  =  0  elsewhere.  From  Eq.  (18)  we  have  the  optimal  LCSE  local 


variance 


varL 


D  = 


£  +  blip  ttL^ 
htal*  2«2 


(28) 


and  for  the  H.T.  processor,  the  optimal  local  variance  for  peak  detection  is 

1  “  K12I  247 r 


varL  &H.  T.  = 


bd5 


kB' 


(29) 


The  local  variance  of  the  LCSE  is  in  general  higher  than  that  for  the  H.T.  pro¬ 
cessor  since  the  H.T.  achieves  the  Cramer-Rao  Lower  Bound  locally.  As  expected 
from  the  preceeding  comments,  the  presence  of  a  high  signal-to-noise  ratio,  i.e. 
high  coherency,  will  favor  the  H.T.  because  of  the  term  1  -  |7l2(u;)|2  in  (29). 
However,  at  low  signal-  to-noise  ratio,  both  the  optimal  LCSE  and  the  H.T.  vari¬ 
ance  behave  as  the  inverse  of  the  coherency.  It  is  important  to  note  that  the 
expression  for  the  H.T.  variance  behaves  as  inverse  bandwidth  cubed  while  for 
the  LCSE  it  behaves  as  inverse  bandwidth  squared.  Consequently,  as  far  as  the 
small  error  performance  is  concerned,  the  LCSE  should  perform  comparably  to 
the  H.T.  in  cases  where  the  signal-to-noise  ratio  is  moderate  and  the  bandwidth 
of  the  signal  is  small.  Because  of  the  instability  of  the  H.T.  estimate  for  precisely 
this  combination  of  signal-to-noise  ratio  and  bandwidth  (see  the  discussion  in  Sec¬ 
tion  II),  the  expression  for  the  estimator  variance,  Eq.  (29),  can  underestimate  the 
true  variance  of  the  estimate  by  orders  of  magnitude  [2], [4].  Due  to  the  smoothing 
effect  of  integrating  the  GCC  trajectory,  the  local  variance  of  the  CSE,  Eq.  (28), 
may  more  accurately  reflect  the  actual  performance  of  the  estimator  than  does 
Eq.  (29)  for  the  GCC.  Therefore  the  potential  for  superior  performance  of  the 
LCSE  scheme  may  well  be  underestimated  by  Eqs.  (28)  and  (29). 
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V.  Simulation  Results 

For  the  present  we  are  interested  in  the  performance  of  the  LCSE  scheme  for 
narrowband  signal  spectra,  that  is  the  low  time-bandwidth  product  situation.  A 
preliminary  experimental  investigation  of  the  relative  performance  of  the  LCSE 
and  the  GCC  is  reported  here. 

We  synthesized  two  sensor  sequences  which  contain  a  common  narrowband 
component  in  two  uncorrelated  white  Gaussian  noises  to  exercise  and  compare 
the  HT  and  the  SCOT  processors  with  the  CC-LCSE  and  MF-LCSE  discussed  in 
Sections  HI  and  IV.  Specifically  we  first  generated  a  unit  power  Gaussian  signal 
r(k)  with  periodic  spectrum  on  [-ir,  jt]  via  the  autoregression 

r(A)  =  A  i  r(k- 8)  +  A2  r{k- 16)  +  a  w(k)  ,  k  =  1,  2,  .  .  .  (30) 

where  t u(k)  is  a  white  Gaussian  pseudonoise  sequence  and  At  =  1.77  A2  =  -0.86 
and  a  =  0.17.  Then  r(k)  was  passed  through  a  sixth  order  elliptic  filter  to  yield 
a  lowpass  signal  z(A).  Finally  z{k)  was  modulated  onto  a  sinusoid  to  give  the  sig¬ 
nals  s(k)  and  s(k-D0 ) 

s(k)  =  V2{ad  +  sr  z(k))sin(2nfk  +  <j>)  k  =  1,  2,  ...  ,  5120  (31) 

Here  /  =  0.017,  <f>  is  a  random  initial  phase  uniform  on  [— jt,  ?r]  and  and  3r  are 
the  power  in  the  deterministic  carrier  component  and  the  random  component  of 
«(A)  respectively.  sd  and  sr  were  chosen  to  give  a  carrier-to-signal  power  ratio 
(CSR)  of  -20dB  for  the  amplitude  modulated  (AM)  waveform  in  Eq.  (31).  The 
spectrum  and  autocorrelation  function  of  s(k)  are  shown  in  Figs.  5.1.  and  5.2 
respectively.  s(k)  and  s(k-D)  were  then  contaminated  with  mutually  uncorrelated 
zero  mean  white  Gaussian  noises  n  j(A)  and  n2(£)  to  form  the  two  records 


ii(A)  =  s{k)  +  np  nj(A) 
x2(k)  =  s(k-D)  +  np  n2(A) 


k  =  1,  2,  .  .  .  5120 


(32) 
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D0  was  set  to  25  for  the  duration  of  the  simulation.  The  5120  samples  con¬ 
tained  in  the  above  two  records  were  divided  into  5  distinct  groups  and  the  aver¬ 
aged  cross-spectral  estimate  was  constructed  using  the  Bartlett  procedure.  This 
estimate  was  then  weighted  with  the  HT,  SCOT  and  MF  weights  displayed  in 
Eqns.  (5),  (6)  and  (24).  Since  the  autocorrelation  function  of  the  signal  s(£)  does 
not  fall  off  to  zero  within  (-511,  512],  see  Fig.  5.2,  the  local  center  of  symmetry 
estimator  was  implemented.  The  maximum  length  integration  window  was  used 
for  the  LCSE  when  a  priori  the  true  delay  lies  within  50  bins  of  the  0-th  bin. 
That  is  we  summed  over  451  bins  to  the  left  and  to  the  right  of  each  point  in  the 
interval  [-50,50].  For  the  SCOT  and  HT,  peak  detection  was  performed  and  for 
the  MF-LCSE  and  CC-LCSE,  Eq.  (7)  was  implemented  in  discrete  time  over  the 
a  priori  region.  The  above  procedure  was  repeated  100  times  for  each  of  25 
signal-to-noise  ratios  (SNR)  between  -50  and  40  dB. 

Three  statistics  were  computed  at  each  SNR  for  each  processor:  the  square 
root  of  the  mean-square-error  (MSE)  of  the  estimates;  the  mean;  and  the  8  bin 
frequency  deviation,  i.e.  the  number  of  estimates  falling  within  8  units  of  the  true 
delay  at  25.  These  curves  are  shown  for  the  three  schemes:  the  SCOT;  the  HT; 
and  the  MF-LCSE  in  Figs.  5.3  through  5.5  respectively. 

Referring  to  Fig.  5.3,  for  SNR  above  about  -5dB;  large  errors  become  insigni¬ 
ficant  and  the  HT  outperforms  the  others;  but  by  only  1  bin  in  the  case  of  the 
MF-LCSE.  As  the  SNR  falls  below  the  small  error  threshold  the  MSE  perfor¬ 
mance  of  the  HT  deteriorates  rapidly  with  respect  to  that  of  the  MF-LCSE.  The 
curves  in  Fig.  5.4  indicate  that,  on  the  average,  below  the  -5dB  threshold  the 
SCOT  has  already  lost  all  delay  information,  giving  randomly  distributed  esti¬ 
mates  across  the  entire  interval  [-50,50],  Indeed  the  SCOT  procedure  breaks 
down  much  sooner  than  either  the  H.T.  or  the  MF-LCSE,  exhibiting  a  threshold 
at  least  lOdB  higher  than  the  others.  The  MF-LCSE  picks  up  a  greater  amount 
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of  the  underlying  structure  in  the  GCC  waveform  which  prevents  the  type  of 
deterioration  evident  in  the  case  of  the  SCOT.  The  performance  of  the  HT,  rela¬ 
tive  to  the  average  of  the  estimates,  falls  somewhere  in  between  the  SCOT  and 
MF-LCSE.  Finally  Fig.  5.5  illustrates  the  performance  of  the  three  schemes  rela¬ 
tive  to  the  small  error  performance  measure,  the  frequency  of  the  less  than  8  bin 
deviations.  For  each  of  the  100  experiments,  we  plot  the  percentage  of  estimates 
within  8  bins  on  either  side  of  the  true,  bin  25.  This  gives  an  indication  of  the 
percentage  of  time  that  the  estimate  can  be  expected  to  give  only  small  errors. 
Except  at  the  threshold,  where  a  small  increase  in  performance  of  the  MF-LCSE 
is  evident,  the  HT  and  the  MF-LCSE  have  virtually  identical  small  error  perfor¬ 
mance,  both  significantly  outperforming  the  SCOT  at  all  SNRs  tested. 

In  Figs.  5.6  and  5.7  the  CC-LCSE  experimental  performance  is  displayed. 
From  Fig.  5.6  it  is  evident  that  there  is  virtually  no  gain  in  MSE  performance 
over  the  HT;  however  it  does  outperform  the  SCOT  at  high  SNR.  The  mean 
curves,  Fig.  5.7,  indicate  that  at  low  SNR,  the  CC-LCSE  still  takes  advantage  of 
symmetry  structure  of  the  GCC  trajectory  to  yield,  on  the  average,  better  esti¬ 
mates  (by  2  or  3  bins)  than  the  GCCs.  The  poor  performance  of  the  CC-LCSE, 
and  the  other  GCC’s  investigated  here,  reflects  the  sub-optimality  of  any  W(u;) 
which  does  not  specifically  attempt  to  maximize  the  denominator  of  Eq.  (20). 

The  modulus  CSEs  (MCSE)  were  also  included  in  the  simulation.  However 
they  failed  to  give  solutions  to  the  zero  location  problem,  Eq.  (10),  for  about  half 
of  the  100  tests  at  low  SNRs  and  the  results  are  omitted  from  this  study.  Of 
course  this  is  not  a  conclusive  indication  of  the  potential  performance  of  the 
modulus  CSE  techniques  since  the  MF  and  CC  weights  are  not  optimal  in  the 
sense  of  minimizing  local  variance.  The  specific  optimization  of  the  MCSE  vari¬ 
ance  expression  should  yield  estimators  which  give  a  more  favorable  standing  to 
the  MCSE  than  that  resulting  from  the  present  simulation  study. 
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VI.  Discussion 

In  this  chapter  several  forms  of  the  center  of  symmetry  estimator  were 
presented,  which  are  simple  modifications  of  the  Generalized  Cross  Correlation 
method  for  time  delay  estimation.  A  particularly  simple  family  of  CSE  pro¬ 
cedures,  the  LCSE’s,  was  obtained  by  using  a  Walsh  expansion  to  characterize 
the  asymmetric  part  of  the  GCC  trajectory.  Based  on  an  optimization  of  the 
variance  of  the  LCSE  over  GCC  filters,  an  optimal  filter  function,  the 

” matched  filter,”  was  derived.  Even  though  the  target  performance  functional, 
the  local  variance  of  the  CSE,  may  not  be  valid  for  large  errors,  the  resultant 
optimization  produced  estimates  which  seem  to  possess  better  large  error  perfor¬ 
mance  than  the  GCC  techniques  for  narrowband  signal  spectra.  It  is  believed 
that  this  follows  from  the  fact  that  the  LCSE  is  less  sensitive  to  peak  ambiguities 
than  the  GCC  for  narrowband  spectra. 

The  local  variance  analysis  indicates  that  in  general  the  GCC  is  a  more 
accurate  estimator  for  small  errors  than  the  CSE.  This  is  also  evident  for  the 
LCSE  from  the  simulation  results  discussed  in  the  preceeding  section.  One  possi¬ 
ble  estimation  strategem  would  be  to  use  the  GCC  and  the  CSE  in  a  hybrid 
manner.  Using  the  CSE,  one  could  obtain  initial  rough  estimates  for  the  location 
of  the  (local)  peak  in  the  GCC  trajectory  which  actually  corresponds  to  the  true 
time  delay.  This  would  be  a  variant  of  a  "gated  mode”  implementation  of  the 
GCC.  That  is  one  would  censor  the  GCC  output  outside  of  some  region  deter¬ 
mined  by  the  rough  estimate  obtained  using  the  CSE,  and  estimate  the  delay  as 
the  location  of  the  highest  peak  within  the  gated  region.  Further  study  of  this 
and  other  uses  of  the  CSE  remains  to  be  undertaken. 
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APPENDICES 

Chapter  3 


Appendix  A 


Here  the  expression  Eq.  (18)  is  computed  assuming  R9  (r)  has  covariance 
given  by  (C.13)  in  Appendix  C.  First  compute  the  variance  of  o  j( D 0 )  defined  in 
Eq.  (7). 


D,  D.  +L 

var[o  |(D„  )j  =  rarj  /  R9(t)<1t-  f  R9(t)<1t 


D.-L 


D, 


(Al) 


D,  D,  D,  +L  D,  +L  D,  D,  +1  D,  +L  D,  ) 

/  /  +  /  /  -  /  /  -  /  / 

D,  -L  D,  -l  D.  D,  D,  -L  D,  D,  D,  +L 


drd<r  cov(/?  3  (t),R  3  (<r)J 


In  Appendix  C  it  is  shown  that  for  sufficiently  broadband  signals,  s(t),  R  l2  is 
covariance  stationary  except  at  points  r  very  near  D„  ,  say  r  G  [. D~ ,  D0+].  In  any 
case  the  difference  between  the  covariance  functions  involving  R  9  within  the 
immediate  neighborhood  of  the  true  time  delay  and  outside  of  that  neighborhood 
is  bounded  by  a  factor  of  two 

(cov[i?  l2(D0  ),R  12{D0  +r)l/ cov[R  12[ti),R  12(i/+r)j  <  2  ,  rj  Dt).  Hence  we  can 
consider  the  evaluation  of  the  integrals  in  Eq.  (A.1)  over  regions  which  do  not 
include  [D~,Dt+\  without  significant  change  in  the  resulting  variance  expression 
if  the  signal  is  broadband.  Accordingly  define  the  spectrum  C{w)  of  R  i2{t) 

00 

I  cov[R12(n),Rl2(n+r) j  t-r"dr 
-00 


R  9  then  has  the  spectrum  C{w)\  VF(u;)|2  and  the  correlation  function 

1  “ 

p(r)  =  eov[R9  (<r),R3  (a  +  r)]  =  -—  /  C[w)\  W(w)\2dw 

23r  -CO 

We  can  rewrite  Eq.  (A.1)  with  the  obvious  definition  of  regions  72,  73  and  74 
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to  obtain 

var\o  )]  =  f  /  +  /-/-/  j  dA  p{T-a)  ,(A2) 

{  'll  72  73  74  J 

where  dA  =  dr  da. 


Making  the  change  of  variable  v  =  t-<t,  the  regions  ~ih  72,  73  and  74,  in  Fig.  A.1, 
are  mapped  to  the  regions  7/  ,  72 , 73  and  74  ,  in  Fig.  A.2,  where,  for  purposes 
of  clarity,  Dt  is  assumed  to  be  positive.  We  thus  have 

var[<>i  {D0  )1=J  /  +  /-  /-  /J  dA'  • p(v )  (A3) 

l  7x  7s  73  74  J 

where  dA’  =  dr  dv. 


We  will  deal  with  the  four  above  integrals  individually  by  integrating  first  over  r. 

Consider  the  integral  over  the  region  7/  in  Eq.  (A3) 

0  *+£>.  l  D, 

f  p(v)dA  —  j  dv  f  dr  p(v)  +  J  dv  f  dr  p(v) 

71  D,  -L  0  v+D,  -L 

L 

=  /  {L  -|  v  | )  p{v)dv  (A 4) 

-L 

Likewise  for  the  region  72 

0  v+D,  +L  1  D,  +L 

/  p(v)dA  =  /  dv  /  dr  p(v)  +  J  dv  J  dr  p(v) 

72  Do  0  v+D0 

L 

=  /  {L  -|  v  |  )  p(v)dv  (A5) 

-L 

And  for  73’ 

J  p{v)dA' 

73 

-L  v+D,  +L  0  D, 

—  f  dv  f  dr  p(v)  +  J  dv  J  dr  p(v) 

—2  L  D9  —It  —L 
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-L  0 

=  /  (v+2 L)  p{v )  dv  +  J  (-v)  p(v)  dv  (A.6) 

-2  L  -L 

In  a  similar  manner  for  the  region  74 


/  p{v)dA' 

t* 

2L  L 

—  /  (-v  +  2L)  p(v)  dv  +  f  v  p(v)  dv  (A.7) 

L  0 

Note  that  p{v)  =  0  for  |  v  |  >  Te'  ,  where  Tj  is  defined  in  Eq.  (3).  Therefore  if 
L  »  T’  the  first  term  in  Eqns.  (A.6)  and  (A.7)  are  negligible.  Performing  the 
indicated  algebra  in  Eq.  (A.3)  using  Eqns.  (A. 4)  -  (A.7)  with  the  above  assump¬ 
tion  we  obtain 


var[o  X{D0  )j  —  2L  /  (1  -  )  p(v)  dv  (A.8) 

—It 

or 


var[o  i(Dg  )]  «  2 L  f  p(v)  dv 
-L 


(A.9) 


Finally,  combining  Eq.  (A.9)  with  Eq.  (17)  and  substituting  into  Eq.  (13),  we  have 


/  (i-  -^2"  ) dv 

VarL  [D]  ~  ~  - - T 

2  (i?M(r)  *  u<r)|  _0) 


(A.  10) 


Since  p  is  symmetric  and  L  »  Te'  the  numerator  of  Eq.  (A.  10)  can  be  con¬ 
sidered  as  the  convolution  of  p(r)  and  (1  -  |r|/L)  evaluated  at  r  =  0.  Or  in  the 
frequency  domain  we  have 


varL  PI  =  j 


/  hMQv) \W{w)\2dw 
2 T  -00 


2t 


f  G,t  VV(  w )  dw 

-oo 


(A.11) 
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where 


8 i  =  2Lsine2(wL) 

stne(x)  =  -3-*D^ 
x 

In  the  limit  of  large  values  of  L  Eq.  (A.  10) 


varL  PI  =  J 


Q(»)l  mo)l3 

/  G„  W[w)dw 


(A- 12) 
(A.  13) 


(A.  14) 


Appendix  B 

Here  the  local  variance  of  the  MCSE,  Eq.  (21),  is  derived  when  the  second 
order  distributions  of  Rg  are  known.  We  first  need  a  result  on  the  characteristic 
function  of  the  modulus  of  a  random  variable. 

Let  X  be  a  random  variable  with  density  function  fx(x)  and  infinitely  dif¬ 
ferentiable  characteristic  function  Then  the  characteristic  function,  <f>^, 

of  the  absolute  value  of  X  is  given  by 


=  Re  ^x(0  +  *  H  (Re  <£x(0)  (B.l) 


where  H  (Re  <^(t))  i3  the  Hilbert  transform  of  the  real  part  of  <f>x{t) 


=7  J  -p- 

7T  _  t-U 


(B.2) 


Furthermore,  the  moments  of  |A|  are  given  by 


.  «2“  M‘) 


E{|Ap }  = 


H)” 


E{Pq2-'}  =  -(-1) 


dt2* 

_1_  j  (2n-l)f 


(B.3) 


7 r 


2n  <t>xiu)du 


To  show  this  we  first  need  a  couple  of  preliminary  results.  One  form  of  the  Dirac 
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delta  function  is  the  integral  (Cauchy  principal  value) 

00 

/  tita  dx  =  2xf(t) 

-OO 

which  has  the  property  that  for  any  integrable  function  g{t0  ) 


(B.4) 


/ 


/  e  dij  g(t)dt  =  g{t 0)*2x 


(B.5) 


We  can  obtain  a  useful  characterization  of  Eqn  (B.4)  in  the  context  of  Cauchy 
integration  in  the  following  way. 

Consider  the  contour  integral  for  t  <  0,  /  t ,tz  dz,  where  z  is  a  complex  vari- 

c 

able  and  C  is  the  contour  of  Fig.  B.l. 


Then  by  the  residue  theorem 


Now 


/  e  **  dz  = 
2jt»  j 


R  2ir 

=  -L  [  e{t*dz+  - i-r  (iR)  f  e  W'^dv 
2n  _R  2xi  K 


|  g  i(e/?c,#+0)  |  <  |  e  ii+itR  cos  4  |  £-tR  sin  4 

<  etR  for  0  €  (ar,  2:r] 

Therefore  combining  Eq.  (B.6)  and  inequality  (B.7)  and  taking  the  limit 


(B.6) 


(B.7) 
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R 

I  lim  /  e %u  dx  |  <  lim  Reti?  =  0 

fl-co  _R  -  i?-00 


(B.8) 


for  /  <  0. 

For  t  >  0,  just  use  the  mirror  image  of  the  contour  in  Fig.  B.l  to  obtain  the 
identical  result. 

For  the  case  t  =  0 


R 

lim  /  e  *ta  dx  —  lim  2 R  (H.9) 

fl-co  _R  R~ CO 

Or  comparing  Eqns  (B.4)  and  (B.9),  we  have  the  identity 

lim  1  (t)  R  =  jrS(t)  (B.10) 

R—oo 

where 


f  1  t=0 

(  o  ty£  0  (B-11) 

The  above  identity  will  enable  us  to  show  the  following  fact 

00 

J  e  dx  =  t<5(u)  +  »  —  (l-l(u))  (B.12) 

o  u 

where  the  imaginary  part  of  Eq.  (B.12)  has  the  interpretation:  —  (l-l(u))  is 

u 

equal  to  zero  for  u=0  and  equal  to  —  ,  otherwise.  Consider  the  function  of  a 

ti 

complex  variable:  e 102 .  This  has  a  pole  at  z  =  -sgn(v)  ico. 

For  u  >  0,  we  consider  the  contour  integral  over  the  path  C  shown  in  Fig. 


/m  2 


B.2. 
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Then  we  have 


1 

2  x» 


J  e  in*  dz  =  0 

c 


1 

2xi 


(B- 13) 


R 

f* 

0 


dx  + 


2xt 


J 


- 


2;rt 


i R 


f  e iv*  dx 
o 


—  Ir  +  h  +  h 


First  compute  / j 


(B.14) 


1 

2x» 

i?i 
2  XI 


ir/2 

J  eiuRt' *  Reif  id9 
0 


ir/2 

J“  ^  -tii?  sin  $  ^  cos 
0 


Note,  that  since  a  >  0,  /j  — ►  0  as  R  — *  oo.  /2  is  however,  non-zero 


(B.15) 


or  as  R  — *  oo 


-1 

2xi 


^2 


£  _J_ 

a  2xi 


(B- 16) 


(B-  IT) 


giving  the  result  from  Eq.  (B.14) 


lim  — — :  /  e  dz  —  — ^  f  elttx  dx  -  lim  —^7  1(a) - —  1  — 

00  2xi  ^  2xi  q  R— 00  2xi  2x«  a 


(B.18) 
( !-!(«)) 


We  use  Eqns.  (B.13)  and  (B.10)  to  obtain  from  (B.18) 


CO 

/  e  dx  =  x<5(a)  +  «  -  ( l-l(a)) 


Note  that  formally 


OO  OO 

J  e  dx  =  /  e  •’«  dx  + 

-00  0 


00 

/  e  “  dx 
0 


=  2x(5(a) 


(B.  19) 


(B.20) 
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as  expected. 

The  result  for  u  <  0  falls  out  of  the  above  by  considering 


/  <-1«l  *dx  = 
0 


CO 

/  e'l 
0 


=  *£(„)  -  ;-i-  ( !-!(„))  (B.21) 


=  k6(u)  +  »  —  ( !—!(«)) 


Now  we  show  the  main  result,  (B.l)  and  (B.3),  for  the  characteristic  function  of 
the  modulus  of  a  random  process  X  with  fx(x)  and  <j>x(t )  the  density  and  charac¬ 
teristic  function  of  X,  that  is,  X  ~  fx(x),  and  <t>x{t)  =  E{e ,ty}. 


CO 


*pq(«)  =  /  +  /  e-ixtfx(x)dx 

0  -oo 

CO 

=  ;  few+AHi* 


(B.22) 


00 

/  e{xt 

o 


00 


27  /  *-*"  I  **(•)  + «<•)]* 


dx 


1  °° 

—  /  Re^x(u) 


00 

/  e'^dx 
0 


du 


By  (B.12),  for  t  -  u  ^  0; 


/  c^'Ux  =  ir6(t-u)  +  «  — 

n  t—u 


(B.23) 


Hence, 


00  Re( 4>x{u]\ 

^pq(0  =  ^e{^x(0}  +  *  —  /  - -  du  (B.24) 


=  Re{^(0}  +  .‘if(Re{^(0}) 
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It  is  well  known  that  if  X  has  moments  of  all  orders 


dn 

dtn 


Etc®}  l,.o  =  (O'  E{X*}  = 


n 

(-1)Y  E{Xn} 


n-1 

(-1)  2  »  E{Xn  } 


n  even 
n  odd 


Therefore,  we  can  calculate  the  moments  of  |X] 


(-I)*  E{\A2n  }  = 


c?2»Re{^(<)} 


dt 


2* 


lt-0  +  «  / 


(2n)! 


-OO 


(-«) 


2»+l 


Re^(u)  <fu(B.25) 


By  the  symmetry  of  the  real  part  of  <f>xiu)  about  zero  the  second  term  on  the 
right  hand  side  of  Eqn  (B.25)  is  zero.  Noting  that  the  the  imaginary  part  of  an 
even  derivative  of  <f>x( t)  is  zero  at  t  =  0,  Eqn  (B.25)  becomes  simply 

„  du<f>x(t) 

(-1)'  E{|X|2" }  =  -  f  (B.26) 

ot 

as  expected.  Likewise 


(-D”  *  W'>  =  -  7  i  (B •«) 

The  first  term  on  the  right  hand  side  of  (B.27)  is  zero,  therefore 


(B.28) 


Etw2-1}  =  -(-1)”  !  7  R efcr  («)«*« 

-00  U 

Since  the  imaginary  part  of  <j>x{u)  is  odd  we  have  as  a  final  result 

<j>x{v)du,  (B.29) 


2n-l\  _  /  i\»  _L  r  (2n-l)! 


E{|X12b_1}  =  -(-!)"  ±  /  2b 


From  Eq.  (B.3),  the  expected  value  of  the  modulus  of  the  G.C.C.  trajectory, 
|  R 1  (r)  |  is  known  if  the  characteristic  function  of  R g  (r)  is  known.  Defining  Z 
as 


Zt,r=\R<(t)R<(T)\ 


(B.30) 
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Eq.  (B.3)  gives  the  autocorrelation  function  of  |  R  1  (v)  |  if  we  know  the  two 
dimensional  characteristic  function  of  R  9  (/),  R  9  (r).  Define 


lit,  t)  =  E{ZtJ -E{  |  R*(t)  |  }  E{  |  R’(r)  |  } 
*t(u)  = 

$t(<T(u)  =  £{«•'«*' 

Then  from  (B.29), 

00 

E{|fl'(<)l>  =  -7  /  -V  *,(«)<(» 

-00 

I/(/’T)  =  T  /  “T 

*  -CO 

00  (  C° 

z  f  ~ T  («)</«  *7  /  ~ 


7,1  -CO  « 2 


(B.31) 


(B.32) 


Substituting  the  above  equations  into  the  expression  Eq.  (13)  gives  the 
result,  Eq.  (21). 
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Appendix  C 

Here  the  covariances  of  the  sample  cross-correlation  f?12(r)  and  the  GCC 
trajectory  R\2{t),  Eq.  (2),  are  derived.  It  is  then  shown  that  the  above  two 
correlation  functions  are  approximately  covariance  stationary  outside  of  the 
region  [~Te  +  D0,  Te  +  D0],  where  D0  is  the  true  delay  parameter.  We  will 
specifically  assume  that  the  waveforms  xx  and  x2  are  Gaussian  random  processes 
as  given  in  Eq.  (1)  with  spectra  G  xx,  and  cross-spectrum  G  n.  Define  Te 
the  signal  correlation  time. 

Let  W[w)  =  1  in  the  expression  for  the  GCC  trajectory,  Eq.  (2).  Then  the 
cross-correlation,  R  12(r),  is 

m  Tk 

=  —  E  /  ^  i*  (^)  ar2*(<T+r)rf<7  ,  r  6  \-Dm  ,  Dm  ]  (C.l) 

m  k—  1  1 

Define  the  covariance 

*n,  n+r  =  cov{  R  M,  R  uil+r))  (C.2) 

Since  T/k  »  Te  the  integrals  in  Eq.  (C.l)  are  approximately  independent 
and  the  covariance  operator  in  Eq.  (C.2)  commutes  with  the  summation  in  Eq. 
(C.l)  to  yield 

<7n,n+r=~zj  S  cov{R  i2(rt),R  xz^+t))  ,  r  €  {-Dm  ,  Dm  ]  (C.3) 

1 

n 

where  R  f2(»/)  =  /  x lk  (tr)  x2t  (<r+rj)d<T. 

T\k-l) 

For  simplicity,  we  will  take  m  to  be  unity  in  Eq.  (C.3),  the  result  for  the 
general  case  follows  directly.  Thus  Eq.  (C.3)  becomes 
T  T 

<Tr/l,+r  =  /  da  J  du  eov(  x  xk  (a)  x2k  {a+rj),  xu(«)  x2k  (n+iy+r))  (C.4) 
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From  the  Gaussian  and  zero  mean  assumptions  imposed  on  x j  and  x2,  we  can 
express  the  covariance  under  the  sum  in  Eq.  (C.4)  as 


COv{  Xlk{(T)x2k{<T+T]),  Xlk{u)x2k{u+TJ+T))  =  (C.5) 

=  E{xlk  {a)  !,*(«)}  E {x2k{<r+rj)  x2Jt  («+»?+r)} 

+  E{x1Jk(<r)  ar2Jt(u+» ;+r)}  E{x2Jfe  (<r+»/)  *1Jk(u)} 

=  R  n(u-<r)  iJ^r+u-ir)  +  R  12(»/+r+u-<r)  R  i2(  >?-(«-<’■))  (C.6) 

by  stationarity.  Substitute  (C.6)  in  (C.4)  and  make  a  change  of  variable 
f  =  u— <r  so  that 


<r7j  r)+r=-j;  /  ^R  n(£)  R  22(^+t)  +  R 12 (l+T+Z)  R  12(^)j 


1. 

‘.J4  1 

J 

- 1 

1 

_ 1 

(C.7) 

dZ 


Now  for  a  fixed  tj,  take  the  Fourier  transform  of  both  sides  of  Eq.  (C.7)  to  obtain 
after  some  manipulation 


/  <T,.,+r  (C.8) 

-oo 

=  -“  [  <?nH  G22M  +  G&(w)  *  sinc2(wT/ 2) 

If  T  »  Te  +  Dm ,  then  the  factor  [  1— 1  (C.7)  is  approximately  unity 

throughout  the  non-zero  region  of  the  integrand.  In  this  case, 

00  r  -1 

-jsr  !  [GiM  Ga(w)+  Gfow)  ei"'dw  (C.9) 

-00 

For  the  general  case,  m  greater  than  unity,  if  T/m  »  Te  +Dm  then  from  the 
stationarity  of  xx  and  x2  the  sum  in  Eq.  (C.3)  is  over  identical  quantities  given 
by  Eq.  (C.9).  Therefore 


m 

**  n+T  ~  ~T2  ir 


J  [(7u(w)  G n(w)+  G  12(w)  t&dw 

-OO 


(C.10) 


Let  s(t)  be  a  bandlimited  white  noise  of  bandwidth  2?r/  Te  .  Then 
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00 

-J-  /  Gfaw)  <*>•  C*'iw  =  K»m'{*Wl-D,)+T)/T,)  (C.ll) 

Z1T  -OO 

where  K  is  a  constant  proportional  to  the  signal  power.  Since  smc(x)  falls  off 
rapidly  for  |x|  >  Te  to  a  good  approximation  for  tj,  t]+r  outside  of  the  interval 
\D0  -  T(,  Da  +  Te  ]  we  have 

00 

=  it  I  (C.12) 

—00 

That  is,  R 12  is  stationary  over  the  above  region.  Depending  on  one’s  definition 
of  Te ,  for  a  general  signal,  stationarity  will  hold  for  sufficiently  large  | r|  . 

It  has  been  noted  elsewhere  [5]  that  for  a  general  real  GCC  wieghting,  W(u;), 
the  GCC  is  equivalent  to  passing  the  waveforms  Xj  and  x2  through  filters 
and  H {  respectively,  where  H\H[  =  W ,  and  cross-correlating  the  outputs. 
Therefore  for  the  GCC  implementation 

!  [ a,M  + G*{w) e’>’}  |HW|2 ei"Tdv^c-1^ 
— OO 

where  it  is  assumed  that  TJm  »  Dm  +  Te'  and  T’  is  as  defined  in  Section  II, 
Eq.  (3). 

In  the  derivation  of  local  variance,  undertaken  in  Section  IV,  the  signal  s(t) 
is  assumed  sufficiently  broadband  so  that  its  trajectory  can  be  taken  as  station¬ 
ary  except  in  the  immediate  neighborhood  of  the  true  delay  parameter  D0 .  If 
W(u;)  does  not  cause  significant  spreading  of  the  signal  auto-correlation  function 
then  we  can  approximate  the  covariance  of  R9  by 

00 

^'= -ft  f  G n(”)  Gr(«)  I  Hw)?  .  Ill  >  D.  (C.14) 

and  for  t}  =  D0 

oo  -  *j 

/  [GnW  C22W+ |G12(”')|2J  \W[w)\2  ei-’dw  (C.15) 

—00 
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Thus  we  can  identify  a  GCC  "spectrum” 

C{w)  =  G ii(w)<7 22(10)  +  \G  12{w)\1(jj-D0  ) 


(C.16) 


here  l(r)  is  the  indicator  of  r  =  0. 
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Very  Narrowband  GCC  output. 
Correct  Peak  Occurs  at  Do 


Fig.  2.  I 


A  Small  Noise  Increase  Causes  Abrupt  Jump  in  Peak  Estimate 


Fig.  2.2 
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Fig.  3.1b 


Fig.  3.1c 
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LCSE  procedure  compares  area  between  ' + '  and 
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Local  error  approximat ion 


Fig.  4.1 
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Signal  Spectrum 


Frequency 
Fig.  5.  1 


Auto-correlation  of  signal  z (k) 
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Mean-Square-Error  for  Various  Processors 
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Mean  for  Various  Processors 
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Proportion  of  Estimates  with  8%  Accuracy 


SNR  (dB) 
Fig.  5.5 


Mean-Square-Error  for  Various  Processors 


Fig.  5.6 
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Mean  for  Various  Processors 


SNR  CdB) 
Fig.  5.7 


Proportion  of  Estimates  with  8%  Accuracy 


SNR  CdB) 
Fig.  5.8 


I ntegrat i on  Reg i ons 
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Fig.  A.  1 


I ntegrat i on  Reg  1 ons 


Fig.  A.  2 


Chapter  4 

On  The  Asymptotic  Form  of  Level 
Exceedance  Probabilities 


I.  Introduction 

The  distribution  function  of  the  number  of  crossings  of  a  level  by  a  random 
process  in  a  given  interval  is  an  important,  but  difficult  to  obtain,  function  which 
has  received  considerable  attention  in  recent  years  [8].  Explicit  results  are  known 
only  for  a  handfull  of  specific  random  processes,  e.g.  the  Markov  class.  In  this 
chapter  a  general  representation  for  the  probability  of  getting  one  or  more  level 
upcrossings  is  obtained  for  a  wide  class  of  random  processes,  which  allows  the 
deviation  of  this  probability  from  the  probability  of  getting  one  or  more  points 
from  an  inhomogeneous  Poisson  process  to  be  characterized.  This  representation 
is  then  exploited  to  show  a  limiting  result  analogous  to  results  obtained  by  Lead- 
better  using  extreme  value  theory  for  stationary  processes  [7].  Specifically,  we 
assume  certain  asymptotic  conditions  on  the  trajectories  of  the  process  such  as 
mixing.  It  is  demonstrated  that  if  the  upcrossings  of  zero  are  made  to  become 
progressively  rarer  events,  in  a  sense  to  be  made  clear  later,  then  a  normalized 
version  of  the  number  of  upcrossings  as  a  function  of  time  converges  in  distribu¬ 
tion  to  a  Poisson  process.  Although  the  assumptions  necessary  for  the  proof 
reduce  to  somewhat  stronger  conditions  on  the  random  process  than  those  of 
Leadbetter  [7]  for  the  stationary  case,  the  result  extends  the  asymptotic  theory  of 
level  crossings  to  a  certain  subclass  of  non-stationary  processes. 

Results  of  the  above  type  are  of  interest  in  connection  with  maximum  likeli¬ 
hood  parameter  estimation  when  large  errors  may  be  significant.  As  is  well 
known,  the  Cramer  Rao  Lower  Bound  only  characterizes  local  error;  that  is,  when 
the  estimate  is  in  the  immediate  vicinity  of  the  true  parameter  [11].  When  the 
trajectory  of  the  so  called  "likelihood  function”  is  predisposed  to  display  multiple 
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widely  separated  maxima  over  the  parameter  space  an  additional  large  error 
measure  is  needed.  One  possible  choice  is  the  probability  that  a  section  of  the 
trajectory  exceeds  a  threshold,  specified  by  the  height  of  the  trajectory  at  the 
true  parameter.  This  probability  can  then  be  expressed  within  the  framework  of 
level  crossing  probabilities.  Based  on  the  results  of  this  chapter,  a  Poisson 
approximation  will  be  used  in  the  next  chapter  to  model  the  large  error  behavior 
of  the  maximum  likelihood  estimator  for  time  delay. 

II:  A  Representation  for  the  Probability  of  Up-crossings. 

Let  (A,  $,  P  )  be  a  complete  probability  space  and  define  the  nested 
sequence  of  <x-fields  :  ,  t  £  R  ,  (  C  $  ,  C  for  s  <  u).  We 

assume  the  -measurable  random  process  X{t),  -oo  <  t  <  +oo,  to  have  the 
following  properties:  separability,  almost  sure  (a.s.)  sample  function  continuity, 
existence  of  the  bivariate  densities  of  A(f)  and  A(r),  ft1{y,2),  for  t  jA  r.  Addi¬ 
tional  properties  will  be  imposed  shortly. 

We  define  an  upcrossing  analogously  to  Leadbetter  in  [2].  A  realization  of 
X(t),  x(t),  upcrosses  zero  in  the  interval  [<r,u)  if  there  exists  an  open  interval  cen¬ 
tered  at  some  point  tn  £  (<t,i/),  (f0  -  S,  tv  +  <5)  say,  over  which  A(f)  <  0  to  the 
left  of  and  X[t)  >  0  to  the  right  of  .  We  denote  this  occurence  by  the  nota¬ 
tion  A  a  v.  Symbolically 

(1) 

=  {u;  £  A|  E  tn  £  (<r,  u),  E  8  >  0  ;  a.t.  Xt%_k  <  0  <  +  k ,  for  0  <  h  <  8} 

This  definition  essentially  excludes  any  ”  non-regular”  upcrossings  such  as  tangen- 
cies  or  non-smooth  intersections  of  zero.  It  is  shown  in  [2]  that  A  a,v  is  ‘Im¬ 
measurable  and  that  non-regular  upcrossings  are  of  zero  probability.  Hence  defin¬ 
ition  (1)  is  sufficiently  general  for  our  purposes. 
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We  further  define  the  number  of  upcrossings  by  J^r)  in  [<r,  i/),  denoted 
N[<r,  v),  as  the  number  of  distinct  points  at  which  upcrossings  occur.  More 
specifically  we  define:  N{<t,v )  =  lim  ^  I[At  t  +A).  Here  ]{A)  is  the  indicator  of 

A— oo  f  ' 

A  and  {f,-  }  is  an  increasingly  dense  partition  of  {<r,v)  with  inter  grid  spacing  A. 

By  the  assumed  continuity  of  the  random  process  ,X(<)  it  is  reasonable  to 
expect  that  it  can  be  well  approximated  by  a  piecewise  linear  process  tied  to 
at  a  sufficiently  dense  set  of  points  f  =  t0  ,  th...,t^.  That  is  let  ( t )  denote  a 

random  process  defined  on  an  interval  [t0  ,  ]  for  which 


uo  = 


m 


m)  + 


(</-'.  I2-- 


(<-<») 


t  =  tt 

h  <  t  <  'hi 


(2) 


l„  =  +  W*  ('/  -  ),  *  =  0,  1,  2.  .  .  ,  2“ 

If  Nn  is  the  number  of  upcrossings  of  zero  by  £„(*)  then  the  following  is  due  to 
Ylvisaker  [1]. 

Lemma  1.1 

Let  Nn(t)  be  the  number  of  upcrossings  of  zero  by  in  the  interval 
,  t).  Then  Nn(t)  is  monotonically  non-decreasing  in  n  and  converges 
to  N(t),  the  number  of  upcrossings  of  zero  by  X  in  the  same  interval, 
with  probability  one  as  n  — ►  oo. 


From  the  above  lemma  it  follows  by  monotone  convergence  that 

P{N{t)  <  it)  =  lim  P{Nn  (0  <k),  for  it  =  0,1,2,...  (3) 

ft— *-CO 

Hence  as  far  as  the  computation  of  upcrossing  probabilities  is  concerned  £„(£)  and 
X[t)  can  be  used  interchangeably  in  the  sense  of  (3). 
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The  following  will  be  important  for  the  upcoming  development  and  are 
essentially  Theorems  (2.1)  and  (2.2)  of  [10]. 


Lemma  1.2 


Let  [f„,  tj  }  have  the  partition  {f,  }£0.  Then  with  N[t)  the  number  of 
uperossings  of  zero  by  X  in  [f,  ,  t)  and  Nn  (r,  <r)  the  number  of  upcross- 
ings  by  £n  in  (r,  <r) 


E  W/)l  =  E  =  lim  E  i)  >  0) 

fl-*00  (*—  Q  ft— *00  •  A 


2*  -1 

.*-0 


(4) 


Define  gt>T(y,z)  the  joint  density  of  J£(/)  and  [X{t+T)  -  X[t)]/T  .  Then  by  elemen¬ 
tary  transformations 


M&2)  =  Tft,t+ Ay>y+™)  (5) 

The  following  are  essential  to  the  development  and  are  known  as  Leadbetter’s  condi¬ 
tions  [2,  Thm.  2) 

gt^y,z)  is  continuous  in  t,y  for  each  r,z  (6) 

VtM2)  P  t  (y>2)  as  T  —•  0  uniformly  in  t,y  (7) 

M&2)  ^  K2)  for  al1  t^V,2  (8) 

where 


00 

Jzl{z)dz  <  oo 
0 


If  the  above  three  conditions  hold  then  the  following  representation  theorem  holds  for 
the  probability  of  getting  an  upcrossing  in  ,f),  P[At>  t ),  here  denoted  p(t). 


Theorem  1.1 

Suppose  -Y(r)  has  continuous  sample  functions  with  probability  one  and 
let  the  conditions  (6)  through  (8)  hold.  Then  the  expected  value  of  the 
number  of  uperossings  of  zero  by  X(r)  in  any  finite  interval  [ t9,tj )  is 
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finite  and  given  by 


=  Jh(i)dr 


(9) 


00 


Kt)  ~  S  2  Pr(M<fc 


Furthermore  the  probability  of  getting  at  least  one  uperossing  of  zero  by 
-X(r)  in  {t9  ,/),  p(t),  satisfies  the  relation 


where 


p{t)  =  / A(r)(l  -  p(r))dT  +  Q(t) 
t. 


Q(t)=  lim  £**«,.) 

■-*°°  i—O 


(10) 


(11) 


(12) 


<**{ )  =  P{Nn  ( t;  ,ti+l)> 0,  Nn  (t{  )=0)  -  P{Nn  (*,•  ,t{+1)>0)P[Nn  (t{  )=0) 
Here  {/,•  }£0  is  a  partition  of[t9 ,/] 


Eqn.  (9)  is  obtained  directly  by  modifying  the  proof  of  Theorem  2  of  Leadbetter 
for  downcrossings  [2]  to  the  case  of  upcrossings.  The  proof  of  the  rest  of  Theorem  1.1 
depends  on  a  particular  decomposition  of  the  event  that  an  uperossing  of  zero  by  £n 
occurs  on  ,t),  which  we  denote  Bt>  t .  If  Nn(t)  is  finite  we  can  define  B*:  the 
event  that  the  first  instance  of  an  uperossing  occurs  in  the  subinterval  [cr,i/)  of  [tt  ,t). 
That  is 


B  <7,1/  -  B  a,v  n  Bt,  ,6 


(13) 


where  we  read  this  as:  first  uperosses  in  \a,v)  if  there  is  an  uperossing  in  [<r,v)  but 

none  in  [t0  ,<r). 

We  note  the  following  two  rather  obvious  properties  of  B^„. 


For  [<J,u]  and  [s,t)  disjoint 


(14) 


B  and  B^t  are  disjoint 

and 

—  &t,  ,t  i  *  6  [t0  ,t)  (15) 

Eqns.  (14)  and  (15)  follow  directly  from  the  definition  (13).  The  following  propo¬ 
sition  is  central  to  the  decomposition  alluded  to  above. 


Proposition  1.1 

Let  A  o  v  denote  an  upcrossing  of  zero,  andA}v  the  first  instance  of  an 
upcrossing,  by  a  random  process  A(f)  in  where  X{t)  has  absolutely 
continuous  distributions.  Then  if  the  expected  number  of  upcrossings  of 
zero  tn  \t0  ,t),  N(t0  ,t),  is  finite  the  following  equivalence  holds  with  pro¬ 
bability  one 


2*  -l 

At  t  =  u  Vt 

i-O  ' ' 


(16) 


where  {t{  },£0  is  a  partition  of  [t0  ,fj 
Proof 

Note  that  the  number  of  upcrossings  in  [f0  ,t)  is  finite  with  probability  one  since 

PW*o  ,t)  >k)<  2  P[N{t0  ,t)  =  0  (17) 

which  must  converge  to  zero  as  k  — *  oo  by  the  finiteness  of  the  mean  number  of  upcross¬ 
ings.  Thus  a  "first  instance  of  an  upcrossing”  is  well  defined.  The  inclusion  ”  D”  in  (16) 
is  trivial  since  any  upcrossing  in  a  subinterval  of  [/a  ,tj  implies  an  upcrossing  occurred  in 
the  entire  interval.  As  for  ”  C"  ,  if  there  is  an  upcrossing  in  [<„  ,t)  it  is  either  interior  to 
one  of  the  [t,  ,1^)  or  at  one  of  the  endpoints  f,  ,  »  =  0,  1,  .  .  .  ,2"-l  However  from  the 
absolute  continuity  of  the  distribution  of  X{ /),  with  respect  to  Lebesgue  measure,  this 
latter  event  has  probability  zero.  Therefore  the  proposition  follows. 
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Proof  of  Theorem  1.1 

Partition  ,f)  into  2"-l  subintervals  of  length  A  =  (tf  -  t0  )2""  for  n  =  0,1,.... 
That  is  we  have  intervals  with  f,  =  t0  +  i'A  ,  i  =  0,1,. ..,2".  Define 

o,v  6  {1,  }^=!,  the  event  that  the  polygonal  approximation,  upcrosses  zero  in  [cr,i/), 
i.e.  Nn(a,v)  >  0.  Then  from  Proposition  1  and  Eqn.  (15)  for  k  =  2"  (tl  =  t ) 


2*  -1 


(18) 


Here  we  have  used  the  disjointness  property  (14).  Now  add  and  subtract  the  product 
P[Bt<  ti+i)P(Bt'  ,  )  from  each  term  under  the  sum  (18) 


s'm.O'wu) + «(».)! 

where 


(19) 


10‘ )  -  n  5,'jj-  hb,.Jm)p(b,iA) 

as  in  the  statement  of  the  Theorem,  Eqn.  (12). 

Now  Bt  ,tf  is  equivalent  to  the  event 


{£•(*,)  <  0  <  MW) 


Define 


*/»(*,) 


Combining  Eqns.  (21)  and  (22) 


-  {£« (*, )  <  0  <  (t, )  +  A»/n  (f, )} 

=  {£«  (f, )  €  (-Az,0)  ,  )  =  z  >  0} 

Therefore  by  the  definition  of  the  joint  density,  glj  S,  of  (f,- )  and  tj„  (<,• ) 

oo  0 

piBt,,tr+l)  =  fdzf  9tildx>z)dx 


(20) 


(21) 


(22) 


(23) 


0  -Az 


(24) 
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Now  make  a  change  of  variable  in  the  argument  x  of  (24)  and  substitute  the  result  back 
into  Eqn.  (19)  to  obtain 


2-  20  0 

-  E  [A/<fe/ff,„A(A  *,z)fl(fl, ,.,.)<&  +  g(t,  )]  (25) 

0  -z 

By  the  pointwise  continuity  and  uniform  convergence  conditions,  (6)  and  (7),  for  A  suffi¬ 
ciently  small 

o 

f9t,AAx>z)dx  “  *  p  »(M  >  T  <=  {f,  ,fi+i]  (26) 

-z 

Condition  (8)  asserts  that  z^z)  is  integrable  over  the  positive  real  line  -where  (z)  upper 
bounds  gti^U,z).  Therefore  the  limit  of  (26)  as  A  -*  0  is  bounded  except  possibly  on 
some  set  of  measure  zero.  From  Lemma  1.1  and  Eqn.  (3)  P[Bt  t )  converges  to 
,_)  =  !-  piti ).  Defining 


o 


=  fgliA(Ax,z)P{B,'ti)dx 

-Z 

(27) 

we  have  as  A  goes  to  zero 

a  a(*.  <,(0,2X1  ~  fiu ))  a.c. 

(28) 

and 

«*(*<>*)  <  z{z) 

(29) 

Hence  by  dominated  convergence  the  first  term  of  the  expression  (19)  becomes  in  the 
limit 

Hm  E  (30) 

n—o°  i=0 

2>_j  <»  0 

=  lim  AE  Jdzfg,iA{Az,z)P(Bt  l  ) 

n~*ea  i=0  0  —z 

t  oo  0 

=  lim  fdrfdzfdx  grA(A  x,z)P[Bt  r) 

t,  o  -t 

t  OO 

=  jdrjz  p  r(0,z)(  1  -  f(r))dz  < 

o 


OO 


This  is  the  first  term  in  Eqn.  (10). 
From  the  expression  (20) 
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(31) 


so  that  the  q(t,)  are  absolutely  summable  by  Lemma  1.2  and  the  finiteness  of 
ElMlo  >*/)]•  Finally  Theorem  1.1  follows  by  performing  the  limiting  operation  in  (16)  as 
n  — ►  co,  taking  account  of  the  regularity  conditions  shown  above. 


m.  Asymptotic  Results  Concerning  the  Nature  of  Upcrossings 

Theorem  1.1  gives  an  implicit  relation  for  the  probability  of  getting  an 
upcrossing  in  a  bounded  interval.  Although  the  rate  function  A(r)  may  be  known, 
in  general  the  Q[t)  term  in  Eqn.  (11)  involves  quantities  which  are  not  known. 
Essentially  Q{t),  or  q(t{)  ,  i  =  0,  1,  .  .  .  ,  2”  -1,  (Eqns.  (11)  and  (12)),  are  meas¬ 
ures  of  the  dependency  structure  of  the  upcrossing  process  N  over  disjoint  inter¬ 
vals.  Hence  it  is  conceivable  that  Eqn.  (11)  may  lend  itself  to  an  iterative 
approximate  solution  if  some  sequence  of  increasingly  good  estimates  of  the  Q(t) 
term  is  available.  For  the  present,  however,  Theorem  1.1  can  only  be  used  as  a 
verification  method  for  some  upcrossing  probability  candidate,  p(t),  obtained 
perhaps  by  guessing.  No  constructive  procedure  for  obtaining  p(t)  is  offered  here. 

Eqn.  (11)  can  be  used  to  prove  certain  asymptotic  results  for  a  fairly  general 
class  of  upcrossing  processes,  which  we  will  now  undertake  to  show.  To  motivate 
these  results  the  following  argument  is  useful.  Refering  to  Eqn.  (11),  assume  that 
Nn  converges  to  an  independent  increment  point  process  N  as  n  — ►  co.  Then 
qn  (*,•)  converges  to  zero  for  all  i  and  by  Eqn.  (31),  Lemma  1.2  and  the  finiteness 
of  the  mean  number  of  upcrossings,  qn  ( t{ )  is  summable  over  i  as  the  t{  become 
dense  in  [f9  ,t).  Dominated  convergence  then  allows  us  to  assert  that  Q{t)  =  0 
and  Eqn.  (11)  becomes  equivalent  to  a  linear,  first  order,  homogeneous 
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differential  equation  with  coefficient  h(t)  and  initial  condition  p(t0 )  =  0.  This 
then  has  the  solution 

t 

Pi1)  =  1  -  exp(-Jh i(r)dr)  (32) 

t. 

Eqn.  (32)  is  of  course  valid  for  any  semiclosed  subinterval  of  ,/).  Hence,  by 
the  independence  of  N  over  disjoint  intervals,  the  upcrossing  process  must  actu¬ 
ally  be  an  inhomogeneous  Poisson  process  with  rate  parameter  A(r). 

Unfortunately  the  above  argument  is  fallacious  since,  roughly  speaking,  for 
non-zero  N  on  bounded  intervals  the  independent  increment  property  of  N  is 
incompatible  with  the  sample  function  continuity  of  X(f)  so  that  Theorem  1.1 
does  not  even  apply.  Clearly  then  the  pointwise  convergence  of  Nn  to  an 
independent  increment  process  N  is  an  overly  strong  imposition  on  X[t).  How¬ 
ever  in  the  following  it  will  be  shown  that  for  a  sequence  of  "thinned  out” 
upcrossing  count  processes,  Nm(t0,t)  associated  with  X(f),  a  related  (time  nor¬ 
malized)  random  process  can  be  defined  which  converges  weakly  to  a  Poisson  ran¬ 
dom  process  defined  on  the  interval  (0,1)  as  m  — ►  oo.  These  results  will  depend 
on  additional  assumptions,  such  as  mixing,  on  the  distributions  of  X{t). 

The  basic  idea  is  to  coordinate  sequences  of  random  processes  {Xm  }  and 
intervals  { Im  }  such  that  upcrossings  of  zero  by  Xm  become  "rare  events”  while 
maintaining  a  non-zero  expected  value  of  the  total  number  of  upcrossings  over 
Im.  For  Im  sufficiently  large  any  pair  of  upcrossings  will  become  approximately 
independent  since,  with  probability  close  to  one,  the  events  are  separated  in  time 
by  an  amount  exceeding  the  ”  inter-dependence  time”  (correlation  time  for  Gaus¬ 
sian  case  )  of  Xm  which  can  be  specified  by  the  mixing  condition.  Then  Theorem 
1.1  can  be  used  to  give  the  solution  (32). 

For  simplicity,  and  without  weakening  the  results,  we  set  t0  in  Eq.  (32)  to 
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zero.  Identify  Im  with  the  scalar  Tm 

L  =  [0,  Tm  )  ,  /,  =  [0,1)  (33) 

where  Tm  is  strictly  increasing  to  infinity  as  m  -*■  oo.  In  general,  when  there  is 
multiple  indexing,  subscripts  indicate  indexing  with  respect  to  the  partition,  {t{ }, 
of  the  time  interval  under  consideration  and  superscripts  index  the  quantity  with 
respect  to  the  infinite  sequences  {Xm }  and  {Im }.  Thus  N™{t)  denotes  the 
number  of  upcrossings  of  zero  by  the  polygonal  approximation  to  Xm  ,  over 
the  interval  [0,f)  6  Im  •  Likewise  Nm  is  the  number  of  upcrossings  associated 
with  Xm  itself.  Analogously  to  the  development  of  Theorem  1.1  define  the 
(T-field  generated  by  Xm  on  Btmt> ,  the  event  N™{t{  ,t- )  >  0,  where  t{  and 

tj  are  points  contained  in  the  2"-th  order  partition  of  Im  ;  and  pm  ( t ),  the  proba¬ 
bility  that  Xm  (t)  upcrosses  zero  on  (0,f)  C  [0,  Tm  ). 

The  next  section  is  concerned  with  the  various  conditions  which  will  be 
imposed  on  Xm  for  asymptotic  independence  of  the  trajectories  and  Poisson-like 
behavior  of  the  upcrossings. 

Asymptotic  Conditions 

A  mixing  condition  is  a  statement  concerning  the  asymptotic  independence 
of  the  trajectories  of  a  random  process  on  disjoint  intervals  [<t,i/)  and  (s,r)  as 
| a  -  v\  — *  oo.  For  example  is  "strong  mixing”  [3]  if 

sup  I P[A  n  B)  -  P[A)P[B) I  <  /?,  (34) 

where  A  and  B  are  arbitrary  events 

A  G  $  B  G  $  « 

lim  ft  =  0 


and 
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The  major  weakness  of  "strong  mixing”  is  that  (34)  becomes  vacuous  if 
either  A  ox  B  are  of  vanishingly  small  probability.  Indeed  in  the  present  context 
the  event  A  will  be  contained  in  the  event  that  an  upcrossing  of  zero  occurs  in  an 
exceedingly  small  interval  which  of  course  has  exceedingly  small  probability.  The 
needed  condition  here  is  the  summability  to  zero  of  the  differences  below 

lim  SI  W  D  BD  -  P[A{m)P[Br)\  =  0  (35) 

m,n— co 

A-m  £  $  m  ,  ,  B  m  #=  <f> 

lm  “*  *  lm  =  °{Tm)  as  m  -+  CO 

o  »  an  increasingly  dense  partition  of  [0,  Tm  ) 

A  sufficient  condition  for  (35),  if  the  quantities  P[B{m)  are  summable  over  »,  is 
the  following  form  of  so  called  "uniform  mixing”  [3]. 


Mixing  Condition 

With  the  cr -field  generated  by  the  trajectories  of  Xm  in  [<t,j/),  Tm  a 
monotonic  sequence  increasing  to  infinity,  Xm  is  said  to  be  uniform- 
asymptotic  ally  mixing  ( u-a  mixing)  if 

iw)  -  mm\Ai\  <  <v/„  (as). 

where 


and 


m 

^i  t^H-1 


with 


lim  a 

m— ►  oo 


=  0 


-*■  lrn  =  °{Tm)  ,  as  m  -*  co 


{<,•}£  o  >  an  increasingly  dense  partition  of  \0,Tm) 


Note  that  for  a  dense  partition  {t( }  the  conditioning  in  (36)  will  be  on  the  zero  proba- 
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bility  event  X{r)  =  0  at  some  specific  point  r,  viewed  as  a  limit  through  a  horizontal 
window  [6J.  Thus  in  the  limit  of  dense  partitions,  although  the  conditional  probability 
may  not  be  well  defined  in  the  conventional  sense,  (36)  is  well  defined.  We  state  the 
following  lemma  which  generalizes  the  uniform  mixing  condition  to  multiple  events. 


Lemma  2.1 

Assume  that  Xm  (t)  is  uniform  mixing  in  the  sense  of  (36).  Fix  I  >  0 
and  for  r  >  1  let  E  j,  E 2,  .  .  •  ,  Er  be  disjoint  intervals  indexed  in 
increasing  order,  that  is,  tup  {r  €  E{_x)  <  inf  {r  £  E{ }  for 
i  =  1,  2,  .  .  .  ,  r,  and  seperated  by  at  least  l.  Then  for  A{m  C 


w  Q> Ar)  ■  Si  p|-v’)l  <  e 


(37) 


Proof 

For  r  =  2  Eqn.  (37)  follows  directly  from  the  definition  Eqn.  (36)  and  the  identity 
P{A,  B)  —  P[A  |  B)P[  B).  We  proceed  by  induction. 

\n  n  ad  -  ri  /u-")i 

i=l 

<  i n  n  Ar  rwrm)  -  /*n  a^a?) i  +  p{Armm  n  ad  -  n  /u")i 

1  1  *=1  t=l  i=l 

<^^rm)+«m,/mE^r) 

i= 2 

by  Eqn.  (36)  and  the  induction  hypothesis. 


In  order  to  make  the  upcrossings  exceedingly  rare  events  as  m  co  the  fol¬ 
lowing  "rarefaction”  condition  is  used 

Rarefaction  Condition 

With  N™{(j,i/)  the  upcrossings  of  zero  by  the  polygonal  approximation 
in  [c t,u )  C  (0,  Tm  )  1 V„m  satisfies  a  rarefaction  condition  if  for  lm  —  oo, 
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L  =*T„) 

Tm 

lim  £  WfitiM i)  >  °.  ,t> )  >  0)  =  0  (38) 

m^°°  t,  =im 

,  an  increasingly  dense  partition  of  \0,Tm) 


The  above  condition  is  a  strong  condition  on  the  trajectories  similar  to  ,  but 
possibly  more  restrictive  than,  the  condition  De'  used  in  [7]  for  the  stationary 
case.  An  additional  condition  needed  is  the  following  which  is  analogous  to  con¬ 
dition  (4.6)  in  [7] 


>  0) 

E{N?(ttt+h)\ 


1  as  m 


oo 


(39) 


o  >  n  ~  n{ m)  i  an  increasingly  dense  partition  of  [0,  Tm  ) 


for  some  h„  ,  0  <  h  <  and  for  all  t  (=  [0,  Tm  ). 

Condition  (39)  is  stronger  than  a  well  known  necessary  condition  for  a  pro¬ 
cess  to  be  (asymptotically)  Poisson:  for  infinitesimal  intervals  the  probability  of 
getting  a  point  is  proportional  to  the  expected  number  of  points  in  the  interval 
(linear  in  the  length  of  the  interval  for  stationary  processes).  The  condition  can 
be  interpreted  as  an  extension  of  this  necessary  condition  to  certain  finite  inter¬ 
vals. 

We  state  here  two  additional  conditions  particular  to  the  nonstationary 
situation,  which  guarantee  that  the  behavior  of  the  upcrossing  process  is  suffi¬ 
ciently  uniform  over  time  to  exclude  degeneration  of  the  upcrossing  probabilities. 


Uniform  Denseness  Condition 

Let  N™{r,s)  be  the  number  of  upcrossings  of  zero  by  in  the  interval 
[r,s).  Assume  one  is  given  a  positive  integer  K,  and  an  interval 

J  =  M  C  [0,  Tm  ),  r,s  £  {t{  }£i,  whose  length  ||J||  is  o(^~  ).  Then 

K 
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given  any  point  tp  in  the  partition  and  an  e  >  0  the  Uniform 

Denseness  Condition  is  satisfied  if  there  exist  sufficiently  large  M,AT 

and  an  interval  I  =  \a,u]  C  [0,  Tm  ),  a,v  £  {*,•  }£i,  containing  tp 


whose  length  ||/]|  is  also  o{-~-  )  such  that 

K 


|E[iV."(J)l  -  E[J\™il  <  £  ,  m  >  M,n  >  W  (40) 

Asymptotic  Uniform  Negligibility 

Let  N™  be  the  number  of  uperossings  of  zero  by  £„m  in  Im  =  [0,  Tm  ) 
and  let  {r,-  },£0  be  a  partition  of  Im  of  size  K.  Then  with  K  th « 
number  of  uperossings  within  the  k-th  partition  element,  [r*  ,rfc+1],  Xm 
satisfies  uniform  asymptotic  negligibility  if 

E(JV~) 

lim  —p -  =  0  (41) 

EE[iV”l 

*-I 


Loosely  speaking  (40)  implies  that  the  uperossings  are  lean  enough  so  that  "simi¬ 
lar”  intervals,  of  similar  order  with  respect  to  Im  ,  have  associated  with  them  a  ”simi- 
lar”  expected  number  of  uperossings.  This  will  be  seen  to  imply  a  continuity  property 
on  P[Nm(r,(T)  >  0)  viewed  as  a  map  from  the  sets  [r,<r)  to  the  positive  reals.  (41) 
guarantees  that  in  no  case  will  the  total  number  of  uperossings  over  Im  be  dominated 
by  uperossings  in  small  subintervals  of  Im  .  If  the  process  JY(t)  were  stationary  these 
two  conditions,  (40)  and  (41),  would  be  trivially  satisfied  since  the  expected  values  of 
iVBm(  J)  and  /Vnm(i)  are  identical  if  J  =  (r,s)  and  I  =  (<t,j/)  are  intervals  of  equal  length. 


Main  Theorem 

With  the  above  conditions  we  are  prepared  to  state  the  main  result  concern¬ 
ing  the  convergence  of  a  certain  normalized  uperossing  process,  associated  with 
Xm  (<),  to  a  Poisson  process. 
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Theorem  2.1 

Let  the  a.s.  continuous  processes  Xm{t)  have  absolutely  continuous  dis¬ 
tributions  for  m  =  1,  .  .  ..  Assume  each  Xm  satisfies  Leadbetter’s  con¬ 
ditions  (6)  through  (8),  with,  in  addition,  lm(z)  =  0{  T~l)  in  (8),  u-a 
mixing  of  the  form  (86)  and  conditions  surrounding  Eqns.  (88)  through 
(41).  Denote  by  hm(r)  ,  r  6  [0,  Tm ),  the  rate  function  of  Nm ,  the 
upcrossings  of  zero  by  Xm ,  and  assume  that  T ^  hm  ( rTm  )  converges 

uniformly  in  r  G  (0,1)  to  a  function  A(r)  as  m  -*cc.  Then  with  the  nor¬ 
malized  counting  process  Nm  (r)  =  Nm  ( rTm  )  we  have 

Nm  (r)  — *  N  *  (t)  in  distribution  (42) 

where  N '  (r)  is  a  non-stationary  Poisson  random  process  on  [0,1). 

We  will  need  the  following  lemma  in  order  to  use  Theorem  1.1  for  the  proof  of 
Theorem  1.2. 

Lemma  2.2 

Let  X(t)  be  a  random  process  which  satisfies  the  assumptions  of 

Theorem  1.1  and  denote  by  N[t)  the  number  of  upcrossings  of  zero  by  X 

J 

tn  [0,r).  Let  N  *  (r)  be  the  number  of  points  generated  by  a  Poisson  pro¬ 
cess  in  [0,r)  with  rate  function  h(cr).  Then  the  following  inequality  holds 
on  the  difference  between  p(t)  =  P[N[t)  >  0)  and 
p  '(f)  =  P[N*{t)  >  0). 

I  p(0  -  P  '(01  <  1™  £  e^p{-fh(T)dr)  (43) 

»-*«>  1-0  0 

2* 

Where  <?(f,)  is  given  by  Eqn.  (12)  and  {t{  }-=0  is  an  increasingly  dense 
partition  of  the  interval  [0,f). 
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Proof 

Consider  the  following  integral  equation  for  0  <  t'  <  t 

»' 

)  =  fNjt\  -P*(r))rfr  (44) 

0 

The  right  hand  side  of  Eqn.  (44)  is  the  first  term  in  Theorem  LI,  Eqn.  (10),  for  t  =  t 
and  has  the  solution 

r 

p '(/')=.  1  _  exp(-/A(r)rfr)  (45) 

0 

which  corresponds  to  the  case  where  N*  is  Poisson.  Therefore  subtracting  Eqn.  (44) 
from  Eqn.  (10)  in  Theorem  1.1  and  using  the  triangle  inequality  on  the  resultant  differ¬ 
ence  we  have 

l' 

I  rt*'  )l  <  /A(r)l  p(r)-p‘(r)|rfr+  |g(f'  )|  ,  t  e  [o,/]  (46) 

0 

Recall  from  Eqn.  (11)  if  {*,  }-Le0  is  a  partition  of  [0,f]  with  inter-grid  spacing  A 

t- 

(?(0  =  hm  £  q(iA)  (47) 

«=o 

where  A  goes  to  zero  through  the  values  t2~n  ,  n  =»  0  ,  1  .  .  .  .  From  the  triangle  ine¬ 
quality 

*- 

l«<)l  <  to  £  w;a)|  (48) 

*=0 

Initially  assume  that  t  is  contained  in  the  set  of  points  partitioning  [0yt)  for  sufficiently 
large  n.  With  this  assumption  the  sum  in  Eqn.  (48)  upper  bounds  | Q[t  )|  for  n  suffi¬ 
ciently  large  since  this  latter  quantity  is  upper  bounded  by  the  sum  of  a  subset  of  the 
positive  terms  to  the  right  of  inequality  (48).  Therefore 

«' 

I  )l  <  }H')\piT)-p‘Wr+  K<)  .  >'  e  [o,i) 

0 


(49) 
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where 

2*  -1 

r(t)  —  lim  2  l$(*;)|  (50) 

o 

We  can  now  apply  the  Bellman  -  Grontvall  inequality  for  integral  inequalities  [4]  to  (49) 
to  obtain 

t' 

I  Pi*'  )l  <  KO  exp(/A(r)(/r)  ,  f'  €  [0,0  (51) 

o 

From  Eqn.  (32)  it  is  clear  that  p  *  (t)  is  a  continuous  function.  This  is  also  true  for  p(t) 
since  by  the  definition  of  an  uperossing,  Eqn.  (1),  given  «  >  0  there  must  exist  a  6  <  0 
such  that 

0  <  P{N{t+S)  >  0)  -  P{N(t)  >  0)  =  P[N{t,t+6)  >  0,  N(t)  —  0)  (52) 

<  n\m  < «) 

This  last  term  can  be  made  arbitrarily  small  by  the  absolute  continuity  of  the  distribu¬ 
tions  of  X.  Therefore  Eqn.  (51.)  must  hold  at  t  =  t. 

If  t  is  not  one  of  the  grid  points  {k2~n  f}j?=o  for  some  n  then  for  a  given  n  let  t(0 
be  the  closest  grid  point  to  the  left  of  t  .  Then  for  the  partitions  ty  t  }^0 

Theorem  1.1  holds  for  )  with 

Q{t  )  =  limn_00  {  Yi^k) 

k=Q 

+  V)- P(\.,OP(J0,,-)]>  (53) 

with  <j( t- )  as  in  Eqn.  (12)  and  t,-  =  i2  *  t.  Now  the  difference  in  brackets  displayed  in 
Eqn.  (53)  becomes  arbitrarily  small  as  n  becomes  large.  Hence  the  assumption  that  t ' 
is  a  grid  point  entails  no  loss  in  generality  and  the  lemma  follows. 

We  would  like  Theorem  1.1,  and  thus  Lemma  2.2,  to  hold  for  the  sequence 
Xm  having  the  properties  indicated  in  Theorem  2.1.  The  following  lemma 
addresses  this. 
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Lemma  2.3 

If  the  a. a.  continuous  processes  Xm  (f)  satisfies  Leadbetter’s  conditions 
with, 


in  (8),  and 


I(z)  =  /”•(*)  =  0(  r„->) 


(54) 


Tm  l>„  ( tT„  )  —  A(r)  ,  os  TO—  CO  (55) 

where  convergence  is  uniform  in  r  £  [0,1),  then  Theorem  1.1  holds  for 
\t0  ,tj)  =  [0,  Tm  ).  Furthermore  with  Nm  (t)  the  number  of  zero  upcross- 
ings  by  Xm  on  [t0  ,/) 

1 

E|iV“(r„)|  —  Jh(t)dt  <  CO  (56) 

0 


Proof 

From  Lemma  1.2  and  the  application  of  the  arguments  leading  to  Eqn.  (24)  in  the 
proof  of  Theorem  1.1  we  have  the  relation 

Tm 

E[N"(rm)]  —  Hm  f  Gm(t,A)dt  (57) 

A— 0  0 

where  we  have  defined 


co  0 

Gm{t,  A)  =  / dzj gtmA{A  z,  z)dx 


(58) 


0  -z 


with  gt”( x,  g)  the  joint  density  of  Xm  (/)  and  —  —  +  ^ — —  —  .  A  change  of  variable 


in  the  integral  of  Eqn.  (57)  yields 

l 

E[Nm(Tm)\  =  lim  /  Tm  Gm  (tTm  ,  A)dt 


A—*Q 


(59) 


Substituting  relation  (54)  into  condition  (8)  we  have  that  the  integrand  of  Eqn  (59)  is 
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uniformly  bounded.  By  Eqn.  (55)  and  dominated  convergence,  the  right  hand  side  of 
Eqn.  (59)  converges  to  the  integral 

l 

E[Nm(Tm)}-+  <oo  (60) 

o 

Thus  the  assumptions  of  Proposition  1.1  are  satisfied  and  Eqns.  (16)  through  (27)  are 
valid  in  the  proof  of  Theorem  1.1.  Finally  the  passage  to  the  limit  in  Eqn.  (30)  is  justi¬ 
fied  since  the  integrand,  with  respect  to  r,  is  bounded  above  by  Gm  (r, A). 

Combining  the  above  two  lemmas  gives  the  following 
Proposition  2.1 

Fix  e  >  0  and  for  every  m  >  1  let  Xm{t)  be  a  random  process  which 
satisfies  the  conditions  in  Theorem  2.1.  Let  Nm(<r,r)  and  N™(ct,t)  be 
the  number  of  upcrossings  of  zero  within  \<t,t)  by  Xm  and  the  approxima¬ 
tion  to  Xm  ,  respectively.  Further  assume  that  the  rate  function  of 
Nm  ,  hm  (r),  is  such  that  Tm  hm  ( rTm  )  converges  uniformly  to  a  function 
h[r).  Then  for  pm{t)  the  probability  that  Nm  (0,t)  =  Nm  (0,tTm  ) 
exceeds  zero  and  p  *(t)  the  probability  that  a  Poisson  count  process  with 
rate  function  h(r)  exceeds  zero  in  the  interval  (0,/)  6  [0,1]  there  exists  an 
M  >  0  such  that 

(61) 

1  Pm  (0  -  P  '  (01  <  Km  2  \q  m  (t{  )|  exp(-f  Tm  hm  ( rTm  )dr)  +  c  ,  m  >  M 

n~°°  i—O  o 

where 

?”(',•)  =  Bo" . )  -  f(B,^.)P(B o” , )  (62) 

As  usual  B™ti  is  the  event  that  N™(t{,t}-)  exceeds  zero  for 

2' 

t{  it;  6  {t[  };=o  which  is  an  increasingly  dense  partition  of  the  interval 
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[o,0- 

Proof 

Let  pf,{t)  be  the  probability  that  a  Poisson  count  process  on  [0,  1]  with  the  same 
rate  function  as  that  of  Nm ,  Tm  hn  ( rTm ),  exceeds  zero  in  (0,f)  C  [0,1].  Then  we  have 
by  the  triangle  inequality 

I p»(0-p*(OI  <  Ip„(0-p«(0I  +  Ip*(0-p«(0I  (63) 

By  Lemma  2.3  Xm  satisfies  Theorem  1.1  so  that  by  Lemma  2.2  the  first  magnitude 
difference  on  the  right  of  (63)  is  bounded 

I  Pm  (0  -  <7m  (01  <  Km  £  |<7 "  (0  )l  ezd-f  Tm  hm  (rTm  )dr)  ,  t  6  [0,  1]  (64) 

"-*co  (=0  0 

By  the  finiteness  of  the  integral  of  hm  for  all  m,  (56)  of  Lemma  2.3,  and  the  continuity 
of  the  exponential  function  the  convergence  of  Tm  hm(rTm)  to  h(r)  implies  that  the 
second  magnitude  difference  on  the  right  of  the  inequality,  Eqn.  (63),  is  less  than  t  for 
sufficiently  large  m. 

Another  fact  that  we  will  need  takes  the  form  of  the  following  generalization 
of  Lemma  2.2.3  in  [7]. 

Lemma  2.4 

Let  Xm  satisfy  (6)  through  (8),  be  u-a  mixing  and  satisfy  (88)  and  (89). 

Then  given  e  >  o,  integers  r  >  0,  K  >  0,  positive  quantities  /, 

Tm 

l=o{  Tm  / K )  and  t,  —  <  t  <  Tm  ,  we  have  for  m  sufficiently  large 

(65) 

>  0,  W.-IM  =  0)  <(-£-)  -i-  +  (2r  -  l)a„i(  +  £ 


To  prove  this  we  need  the  following 
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Lemma  2.5 

Let  conditions  surrounding  Eqns.  (88)  and  (39)  hold  for  the  upcrosstng 
process  N™(t),  t  G  Im  and  assume  E\Nm(Tm)]  is  finite.  Let  J  be  a 
subinterval  of  Im  whose  length  l  is  o(Tm  ).  Define  the  collection  of  r  dis¬ 
joint  sets  {fy  },-^q  each  of  length  less  than  the  parameter  hg  in  condition 

r 

(39)  and  covering  J,  J  =  U  Hf .  Then  the  following  holds 

i—i 

Um  | ±  E(J )]  -  >  0)]  =  0  (66) 

m, »— ►oo  j 

Proof 

By  condition  (39)  given  e  >  0  there  exists  an  integer  M  x  sufficiently  large  such  that 
for  m  >  A/j 

EE WWi )]  -  P[NJ\J)  >  0)  (67) 

<  inm* )  >  oxi  +  e)  -  p(n^\j)  >  o) 

Using  the  same  idea  as  in  the  proof  of  Theorem  1.1  linking  upcrossing  events  with  first 
instances  of  upcrossing  events  we  can  write  the  second  term  on  the  right  of  Eqn.  (67)  in 
a  manner  analogous  to  Eqn.  (18) 

WM  >  0 )  =  £  P[Nnm(H{ )  >  0,  Nn”X  U  )  -  0)  (68) 

«=i  >=1 

Therefore  combining  Eqn.  (68)  and  Eqn  (67)  for  m  >  Mx 

tE[Nnm{Hi)\-P{Nnm{J)>0) 

r  Hi  r 

<  E  )  >  0,  Nnm{  U  Hj  )  >  0)  +  e  £  PiN^Hi )  >  0)  (69) 

«=i  '=1  t=i 


The  first  term  on  the  right  hand  side  of  Eqn.  (69)  is  bounded  by  the  expression  whose 
limit  is  zero  in  Eqn.  (38) 
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tnK(Hi)  >  0,  NX  u Hi)  >  0) 

t=i  >=l 

<  i  e  1)  >  o,  Nx*i,ti- o  >  o)  (?o) 

*=»  t,eH, 

Tm 

<  E  WK-  ,«*i)  >  0,  W  f,  ,t i  -[)  >  0) 

Likewise  by  the  "rarefaction”  condition  there  exists  an  A/2  such  that  the  last  term  in  the 
inequality  (70)  is  less  than  e  for  m  >  M2.  Therefore  for  m  >  max(M1  A/2) 

EBfTO ))  -  P{NXJ)  >  0)  <  e(l  +  S  /W(^ )  >  0)  )  (71) 

»=i  *=i 

Since  €  can  be  arbitrarily  small,  as  we  let  m  go  to  infinity  the  limiting  result,  Eqn.  (66), 
follows  from  Eqn.  (71). 


By  the  disjointness  of  the  Hj  in  Lemma  2.5  we  can  assert  that,  for  any 
interval  J  with  length  of  asymptotic  order  Tm ,  if  the  assumptions  of  the  lemma 
are  satisfied  then 

lim  |E[i\TOl  ~  >  0)|  -*>  0  ,  as  m  ->  oo  (72) 

m-+co 

With  the  above  we  can  now  show  Lemma  2.4. 


Proof  of  Lemma  2.4 

By  the  previous  lemma  and  its  implication  (72),  for  t  6  [l,Tm  ):  given  c  >  0  for 
large  enough  m 

i toko  >  o)  -  E[Nxnm  <  <  (73) 


T 

Since  /  =  o(  —  ), 
/v 

implies  that,  for  some 
separated  by  l  such  that 


for  sufficiently  large  m  the  Uniform  Denseness  Condition 

Tm 

r  >  0,  there  are  r  intervals,  {Ef}^  C  [0,  — —  -  /),  each 

K 


-  93- 


|E [NX* )]  -  E <  e  ,  i  -  1,  2,  .  .  . ,  r  (74) 

Furthermore  r  can  be  taken  as  arbitrarily  large  as  m  -*  oo.  Therefore  combining  (74), 
(73),  and  (72)  with  J  —  ,  we  have  for  sufficiently  large  m 


W£)  -  g(m)|  <  3e  (75) 

where  the  triangle  inequality  has  been  invoked  and  we  have  defined 

I 

(76) 

and  as  before  B,m  is  the  event  that  N"{I)  exceeds  zero.  Here  we  will  drop  the  index  m 
for  convenience.  The  left  hand  side  of  inequality  (65)  can  thus  be  bounded 

)  <  P(flM< ,  QBe. )  (77) 

or 


<  f(  n  bE' )  -  p[Bt_it ,  n  BE. ) 


(78) 


Now  from  Lemma  2.1 


|P(.n5B,)-nP(5Ei)|<(r-l)am,, 

1=1  1=1  1  ’ 


and 


(79) 


n^)|  <  raml 

t=l  t=l  ’ 

Hence  the  right  hand  side  of  the  inequality  (78)  does  not  exceed 

(l-qy  +  0(e)  +  (r-l)a,  +  (1  +  0(e)  =  ramJ 

—  9(1  ~?)r  +  (2r-l)a^/  +  0(e) 


(80) 


(81) 

(82) 


where  0(e)  goes  to  zero  as  e  goes  to  zero.  The  first  term  in  (82)  has  a  maximum  value  of 

( — tv  )r  —77  which  is  verified  by  investigating  derivatives  in  the  unit  interval.  We 
r-r  I  r+ 1 


lose  no  generality  by  replacing  0(e)  by  e  in  (82)  which  yields  Lemma  2.4. 
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The  major  technical  portion  of  the  proof  of  Theorem  2.1  is  contained  in  the 
following  proposition. 

Proposition  2.3 

If  the  a.s.  continuous  processes  Xm  (f)  satisfy  the  conditions  stated  in  the 
premise  of  Theorem  2.1  then  for  any  semiclosed  interval  I  contained  in 
[0,1] 

P[Nm  (7)  >  0)  -  1  -  exp(-fh(r)dr)  (83) 

/ 

Proof 

First  fix  /  greater  than  zero  and  K  a  positive  integer.  We  reproduce  Eqn.  (62)  here 

for  clarity.  As  in  Eqn.  (12)  of  Theorem  1.1,  for  the  sequence  Xm  ,  m  =  0,  1,  .  .  .  we 

2* 

have  the  quantities  q  m  (f,* )  on  the  2*  point  grid  {ff  }  ^ 


?m('i )  “  )  -  P[BC,jP{BZti ) 


(84) 


Partition  the  interval  [0,Tm  )  into  K  parts  so  that  the  sum  on  the  right  of  Eqn.  (61)  of 
Proposition  2.1  can  be  represented  as 

s'l» ' ’  (<•  )l  -  Sll »”  )l  +  •  •  •  +  E*  l« 1 ■  (<i  )l  (85) 

t=0 


2* 

where  denotes  summation  over  the  intersection  of  the  grid  {/,  }^_0  and  the  k- th  par¬ 
tition  element,  k  =«■  l,  2,  .  .  .  ,  K. 

Fix  e  >  0  and  let  m  be  sufficiently  large  so  that  Lemma  2.4  holds.  Consider  the 
final  K- 1  terms  in  (85) 

)l  +  •  •  •  +  E*kM  (*.-)!  (se) 


Now  for  each  qm  (fj )  in  (86)  we  add  and  subtract  terms  so  as  to  isolate  the  mixing  dom¬ 
inated  quantities  of  the  form  (36).  That  is  we  obtain  via  the  triangle  inequality 
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Wi)\  <  I (87) 

+  \P[BtiitjP[Bo,tl-,)-  P[Bti,tjP[Bo,0 1 
+  So.O  ~  )l 

Where  we  have  suppressed  dependencies  on  m  for  notational  simplicity.  Using  the  mix¬ 
ing  condition  (36)  on  the  first  term  to  the  right  of  the  inequality  (87)  and  using  simple 
set  identities  for  the  other  two  terms  we  have 


I  $(*«)!  <  B[Bt.  t^)  [a^j  +  fl0, <,_/)]  +  P(Bt.'ti+i,  Bt  _iti,  Boti.t ) 


(88) 


Finally  applying  Lemma  2.4  to  the  second  term  in  brackets  [ )  in  (88)  and  noting  that  by 
monotonicity  the  third  term  in  (88)  is  bounded 


PiB^B^  ,B oV,)  <  nmu ,  tM)  >  o,  Nnm(t,  -l,  ti )  >  0)  (89) 

we  get  by  substituting  the  inequality  (88)  in  (85) 

eV('.)I  (90) 

i=0 


2*  -1 


<  Eil«"to)l  +  P rat  +  {-L-  r  +  e  ]  E 

+  2e  >  o,  ato-m,)  >  o) 


2*  X 

here  f  E  {*,*  }^0  13  the  rightmost  point  contained  in  the  first  partition  element,  [0, — —  ], 

K 

of  the  K- th  order  partition.  Now  applying  the  relation  (31)  and  Lemma  1.2  to  the  first 
term  to  the  right  of  the  inequality  (90)  for  n  sufficiently  large 


EiI»’K)I<E.^J<e[w.”J  +  < 


(91) 


Where  JVB™  is  as  defined  in  Eq.  (41).  Likewise 


EW"  J  <  E <  b(at  (r«)i  +  e 


(92) 


which  gives  via  Eqn.  (90) 
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Hm  Ek"(*i)l 

«-°0  ^ 

<  Urn  E|N”|  +  (2r«..,  +  (-£-  )'  -L-  +<  |{E|N«(r„ )]}  (93) 

m  -*  oo  *  r-fl  r-hl 

+  lim  «**)  >  0,  NWi-l,  t{)  >  0) 

n-co  ^ 

Therefore  taking  the  limit  as  myl  — ♦  oo  ,  /  =  o{Tm  ),  the  first  term  to  the  right  of  (93) 
goes  to  zero  by  Asymptotic  Uniform  Negligibility,  (41),  and  the  finiteness  of  the  limit 
lim  E[iVm(Tm)]  =  E[7V(1)].  The  second  term  converges  to  a  quantity  not  exceeding 

T7l — KXD 

[—  +  e  ]  E [ iV(  1 )] .  However  as  m  becomes  unbounded  r  can  be  made  arbitrarily  large 
r 

and  €  can  be  made  arbitrarily  small,  by  Lemma  2.4,  thus  the  second  term  is  negligible. 
Finally  the  rarefaction  condition,  Eqn.  (38),  asserts  that  the  third  term  vanishes. 

Hence  by  Proposition  2.1,  for  I  =  [0,  t] 

t 

Pm  ( T*  t)  P  '  (0  —  1  -  cxp(-fA(r)Jr) . ,  t  €  (0,1)  (94) 

o 

Proposition  2.3  asserts  that  the  probability  that  the  normalized  upcrossing 
process  Nm  is  greater  than  zero  in  any  interval  contained  in  (0,1)  is  the  same  as 
the  corresponding  probability  for  a  Poisson  counting  process  N  *  in  the  limit  as 
m  — ►  co.  To  show  the  stronger  result  that  Nm  actually  converges  in  distribution 
to  a  Poisson  process  we  will  follow  Leadbetter  [7]  in  making  use  of  a  theorem  in 
[5j.  Using  the  nomenclature  in  [5]  a  point  process  N  is  a-regular  if  for  every  col¬ 
lection  of  intervals  I  contained  in  T[01j,  the  Borel  sets  on  [0,1],  there  exists  some 
array  {/^  }  C  T[01|  of  finite  covers  of  I  (one  for  each  m  =  1,2,...)  such  that 

lim  limsup'£lP{Nm  {Ink  )  >  a)  =  0  (95) 

n— ►oo  m— ►oo  ^ 

We  state  the  following  special  case  of  Theorem  4.7  in  [5]. 


Lemma  2.6 
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Let  Nm  be  a  sequence  of  point  processes  and  N*  a  Poisson  process 
both  defined  on  (0,1)-  Then  Nm  converges  in  distribution  to  N  *  if  and 
only  if  Nm  is  2-regular  and 

lira  P[Nm{U)  =  0)  =  P{N*{U)  =  0)  (96) 

m—*oo 

for  all  U  of  the  form 


u  =  u't,  ,  T,.  c  T[0(1, 

for  r  >  1,  and 


limsupE[Nm  (!}]  <  E(iV'(7)]  <  oo 

m— ►  co 

for  /  C  T  [o,  L| 


(97) 


We  now  proceed  to  the  proof  of  Theorem  2.1  which  at  this  point  only  involves 
showing  that  Nm  of  the  theorem  satisfies  the  conditions  in  Lemma  2.6. 

Proof  of  Theorem  2.1 

Without  loss  of  generality  we  assume  that  the  collection  of  intervals  I  in  the 
a-rcgularity  condition  and  in  (97),  and  the  T  in  (96)  are  sets  of  disjoint  intervals.  For 
each  m,  m  =  1,  -  .  .  ,  define  the  increasing  set  of  disjoint  covers  of  I:  { J ^  }, 
k  —  1,  2,  .  .  .  rm ,  with  each  4*  of  length  lm  /  Tm  (recall  lm  =  o(  Tm  )).  Assume  for 
definiteness  that  J are  ordered  such  that  the  left  endpoints  are  strictly  increasing  as  k 
increases.  With  Nm  as  in  Theorem  2.1  and  jV™  (r)  =  Nm  ( rTm  )  we  have 

E  W"  (Jmk  )  >  1)  -  E  W m  (Jmk  )  >  1)  +  P{  Nm  (jml)  >  1)  (98) 

*=1  k=2 

<  lim  E  E  nmtik,t»i)  >  0,  Nn”\t,k-lm  ,tf)  >  0)  +  E[fr  (Jml) ] 

t.ZJtn,  Tm 

Where  { tk)  are  increasingly  dense  partitions  of  4*  ,  for  k  =  1,  .  .  .  rm  respectively. 

The  first  term  on  the  right  of  the  inequality  (98)  is  bounded  by  the  expression  in  the 
Rarefaction  condition,  Eqn.  (38)  while  the  second  term  converges  to  zero  by  Asymptotic 
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Uniform  Negligibility,  (41),  and  the  finiteness  of  E(Nm  ]  (Lemma  2.3).  Taking  the  limit 
of  Eqn.  (98)  as  m  — *  oo  we  have  that  Nm  is  2-regular  in  the  sense  of  (95). 

Fix  r  >  0.  Because  of  the  absolute  continuity  of  the  distributions  of  Nm  the  inter¬ 
vals  T,-  in  (90)  can  be  taken  as  having  no  common  boundary  points.  Therefore  by  mix¬ 
ing,  Lemma  2.1,  for  any  collection  of  disjoint  intervals  Ti,  T2,  .  .  .  ,  Tr  contained  in 
[0,1] 

\P{  riNm(rmT,)  >  0)-  n^N",(rmT,)>0)|-*0,  asm-*  oo  (99) 

t  1=1 

where  we  have  adopted  the  operator  notation  for  Tm :  Tm[<r,i/)  =  \Tma,Tmv)  for 
0  <  <r  <  v  <  1.  Eqn.  (99)  and  Proposition  2.3  thus  imply  that 

P{  n Nm  (Tm  Ti i)  -  0)  exp(- S  /  Hr) Jr)  ( 100) 

.=  1  T, 

We  have  from  the  additivity  of  the  expectation  operator  over  disjoint  intervals  and 
Lemma  2.3  applied  to  general  intervals  contained  in  [0,Tm  ) 

E(JVm  (f)]  E(N  *  (7)]  <  oo  (101) 

Therefore  the  assumptions  stated  in  Lemma  2.6  are  valid  for  Nm  and  Proposition  2.3 
establishes  Theorem  2.1. 


IV.  Discussion 

In  this  chapter  two  results  were  derived  in  the  context  of  level  crossing  pro¬ 
babilities.  First,  a  representation  of  the  probability  of  getting  one  or  more 
upcrossings  in  an  interval  by  a  general  random  process  was  presented.  This 
representation  in  effect  isolates  the  portion  of  the  upcrossing  probability  due  to 
the  intensity  function  of  the  upcrossings,  from  a  correction  term,  which  charac¬ 
terizes  the  deviation  of  the  upcrossing  probability  from  an  associated  inhomo¬ 
geneous  Poisson  probability.  The  correction  term  depends  on  the  degree  to  which 
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the  upcrossings  can  be  modeled  as  an  independent  increment  process.  By  identi¬ 
fying  conditions  which  asymptotically  force  the  correction  term  to  zero  a  second 
result  was  made  possible:  that  a  certain  time  normalized  version  of  the  upcrossing 
process  can  be  made  to  converge  in  distribution  to  the  inhomogeneous  Poisson 
law. 

Of  immediate  interest  to  us  is  the  use  of  an  inhomogeneous  Poisson  model 
for  the  probability  of  a  random  process  upcrossing  a  curve  or  level.  Future  inves¬ 
tigations  of  the  specific  form  of  the  correction  term,  associated  with  the  probabil¬ 
ity  representation  of  Thm.  1.1,  could  lead  to  useful  expressions  for  the  approxi¬ 
mation  error  incurred  by  using  such  simple  first  moment  approximations.  For 
the  asymptotic  result,  Thm.  2.1,  the  fairly  complicated  conditions,  rarefaction, 
uniform  denseness  and  asymptotic  uniform  negligibility,  could  use  some  simplifi¬ 
cation.  In  particular,  rarefaction  and  uniform  denseness  could  be  replaced  by  con¬ 
ditions  involving  probability  statements  about  the  maximum  process  over  the 
interval  I,  max  X(r),  analogous  to  [7].  For  specific  probability  models  of  the  ran- 

dom  process  of  interest,  e.g.  Gauss- Markov  or  Rayleigh  as  in  [7],  one  would 
expect  the  replacement  conditions  to  be  more  easily  verified,  than  the  conditions 
used  here. 
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Chapter  5 

A  Level-Crossing  Approach  to  Large 
Deviations  in  Time  Delay  Estimates 

I.  Introduction 

In  this  chapter  the  performance  of  the  GCC  is  investigated  for  low 
observation-time-signal-bandwidth  (BT)  products.  The  performance  of  the  GCC 
has  been  characterized  by  the  estimator  variance  obtained  by  a  linearization 
technique  first  introduced  by  P.  Schultheiss  [2].  The  resulting  variance  expres¬ 
sion,  in  [2],  is  equivalent  to  the  Cramer-Rao  lower  bound  (CRLB),  but  it  is  only 
valid  for  ’’good”  estimates,  i.e.  those  close  to  the  true  time  delay.  For  lowpass 
signal  spectra,  the  estimate  will  be  good  in  the  high  signal- to- noise  ratio  (SNR) 
case;  however,  in  low  SNR  situations,  the  estimates  can  be  far  removed  from  this 
local  region.  In  the  latter  case,  the  local  variance  can  underestimate  the  actual 
variance  of  the  estimate  by  orders  of  magnitude.  For  narrowband  signal  spectra, 
the  GCC  may  never  achieve  the  CRLB  [19].  The  disagreement  between  local  and 
actual  variance  was  shown  analytically  to  be  significant  in  the  narrowband  signal 
case  by  Chow  and  Schulthiess,  using  a  form  of  the  Barankin  bound  [4].  The 
deterioration  in  performance  beyond  that  predicted  by  the  local  variance  occurs 
in  what  Chow  and  Schulthiess  call  the  "ambiguity  dominated  region”  on  the 
SNR  versus  bandwidth  plane.  This  region  is  delineated  by  a  SNR  threshold 
beyond  which  spurious  peaks  give  rise  to  exceedingly  poor  estimates  of  time 
delay.  In  [18],  Weiss  and  Weinstein  constructed  a  lower  bound  on  the  error  vari¬ 
ance  based  on  the  Ziv-Zakai  bound.  The  resultant  bound  is  tighter  than  the 
Barankin  bound  of  [4]  and  reveals  the  presence  of  two  seperate  SNR  thresholds 
where  the  lower  bound  on  the  error  begins  successive  rapid  increases  in  magni¬ 


tude. 
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In  this  chapter,  we  develop  approximations  to  the  probability  of  large  error 
and  the  global  variance  of  a  given  GCC  implementation.  The  approximations 
presented  here  are  sensitive  to  large  errors  and  can  be  applied  to  arbitrary  signal 
and  noise  spectra. 

In  a  recent  paper  [3],  Ianniello  investigated  the  effect  of  peak  anomaly  on 
the  performance  of  the  simple  cross-correlator  for  broadband  lowpass  signals 
spectra.  He  obtained  an  approximate  expression  for  the  probability  of  anomaly 
using  a  method  analogous  to  the  approximation  of  the  probability  of  error  in 
Pulse  Position  Modulation  communication  systems.  A' model  for  the  global  vari¬ 
ance  was  proposed,  therein  referred  to  as  the  Correlator  Performance  Estimate 
(CPE),  which  took  the  anomalous  estimates  of  delay  as  lying  uniformly 
throughout  the  a  priori  region  of  delay.  The  above  approximations  are  quite 
accurate  for  the  cases  studied  in  the  references  [3],  [14],  where  the  cross-correlation 
function  has  no  sidelobes  over  the  majority  of  the  a  priori  region  of  delay.  How¬ 
ever,  for  the  general  case  large  positive  sidelobes  can  introduce  errors  not 
accounted  for  in  Ianniello’s  approximation. 

For  bandpass  signals,  Ianniello  made  a  distinction  between  anomaly  and 
peak  ambiguity  in  [19].  Essentially,  ambiguity  denotes  the  occurrence  of  spurious 
peaks  near  the  high  frequency  sidelobes  of  the  cross-correlation,  within  the  cen¬ 
tral  lobe  of  the  envelope  of  the  correlation  function.  Anomaly,  on  the  other 
hand,  is  error  which  specifically  occurs  outside  of  this  central  lobe.  To  the  best 
of  our  knowledge,  no  unified  treatment  of  both  kinds  of  large  error  has  been 
undertaken. 

Here  a  different  approach  to  error  modeling  is  investigated,  using  certain 
level  crossing  statistics  of  the  GCC.  This  approach  will  be  sufficiently  general  to 
handle  large  error  for  small  time-bandwidth  products,  and  for  high  frequency 
bandpass  signals,  since  it  incorporates  the  time  varying  statistics  of  the  GCC  tra- 
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jectory  into  the  error  analysis.  Since  no  distinction  need  be  made  between  ano¬ 
maly  and  ambiguity  in  this  approach,  the  all  encompassing  term  "peak  ambi¬ 
guity”  will  be  used  to  denote  large  error.  In  what  follows,  the  approximate 
equivalence  of  peak  ambiguities  with  suitably  defined  level  crossings  by  the  GCC 
trajectory  will  be  demonstrated.  The  probability  of  peak  ambiguity  can  then  be 
represented  in  terms  of  an  infinite  series  involving  the  moments  of  the  number  of 
these  level  crossings  over  the  a  priori  region.  This  expression  is  exact  for  arbi¬ 
trary  signals  as  long  as  these  moments  are  finite  and  smooth.  In  particular,  the 
time  varying  statistics  of  the  GCC  output  (i.e.  sidelobes)  are  taken  into  account 
by  the  level  crossing  model.  Here  the  emphasis  is  on  predicting  the  large  error 
performance  using  knowledge  of  the  first  moment  only,  that  is  the  average 
number  of  peak  ambiguities  over  the  a  priori  interval.  Based  on  the  first 
moment,  a  general  Poisson  model  for  peak  ambiguity  is  investigated,  motivated 
by  asymptotic  considerations  studied  in  the  previous  chapter.  The  Poisson  model 
leads  to  an  expression  for  the  global  variance  which  incorporates  the  variance 
approximation  of  [2]  and  the  intensity  function  of  the  ambiguous  peaks,  the 
instantaneous  average  number  of  peak  ambiguities.  The  resultant  expression  for 
the  global  variance,  var[D\ ,  has  the  form 

var[D]  =  Pe  varA  +  (1  -  Pt  )varL 

where:  Pe  is  the  probability  of  peak  ambiguity,  varL  is  a  truncated  version  of 
the  local  variance  [2],  and  varA  is  a  measure  of  the  mean-square  distance  of  the 
locations  of  the  ambiguous  peaks  from  the  true  time  delay  (the  second  moment  of 
the  intensity  function  over  time).  Specific  results  for  the  intensity  function  of  the 
ambiguities  are  then  derived  using  a  Gaussian  approximation  to  the  GCC  output 
and  an  asymptotic  analysis  is  performed  for  broadband  signal  spectra  and  large 
time-bandwidth  products  (length  of  a  priori  region  times  bandwidth  ( Dm  T)). 
One  result  of  the  analysis  is  that  at  high  SNR  the  locations  of  ambiguities, 


-  104- 


specifically  the  intensity  function,  become  essentially  independent  of  time,  while 
at  low  SNR  the  time  dependency  behaves  approximately  as  1  /(Br)2,  where  B  is 
the  signal  bandwidth  and  r  ranges  over  the  a  priori  region.  The  limiting  form,  as 
Br  — ►  co,  of  the  average  number  of  ambiguities  are  valid  for  all  ranges  of  SNR 
and  are  simple  to  evaluate,  involving  no  integrations. 

For  the  case  of  signals  with  flat  lowpass  spectra,  it  can  be  shown  that  the 
Poisson  approximation  to  the  large  error  performance  of  the  GCC  is  conservative; 
it  over-estimates  the  actual  probability  of  ambiguity.  However,  the  threshold 
SNR,  delimiting  the  onset  of  severe  peak  ambiguity,  is  underestimated  on  the 
order  of  less  than  3dB  for  the  cases  of  lowpass  signal  spectra  considered  here. 
Motivated  by  heuristics,  a  model  for  the  approximation  error  between  the  Poisson 
and  the  actual  ambiguity  probability  is  discussed.  Using  results  obtained  in 
Chapter  4,  an  improved  Poisson  approximation  is  derived  which  adjusts  the 
intensity  function  of  ambiguities  downward.  The  Poisson  motivated  approxima¬ 
tions  to  ambiguity  probability  and  global  variance  are  then  compared  to 
Ianniello’s  probability  of  anomaly  and  the  CPE  for  the  broadband  signal  cases 
studied  in  [3], [14). 

Finally,  a  numerical  study  of  the  behavior  of  the  average  number  of  ambi¬ 
guities  and  the  Poisson  probability  and  variance  approximations  is  undertaken 
for  narrowband  bandpass  signal  spectra.  For  low  BT,  a  positive  indication  of  the 
location  of  the  lower  of  the  SNR  thresholds,  and  the  SNR  value  indicating  the 
onset  of  the  domination  of  a  pnorninformation  over  the  observations,  given  by 
the  Ziv-Zakai  Lower  Bound  (18),  is  provided  by  the  approximations.  However, 
the  approximations  indicate  that,  for  low  BT,  the  upper  SNR  threshold,  indicated 
in  [18],  is  overly  optimistic,  i.e.  the  CRLB  is  unattainable  using  the  GCC.  There¬ 
fore,  in  this  case  the  GCC  is  not  an  efficient  (optimal)  estimator.  For  high  BT, 
the  location  of  the  higher  SNR  threshold,  where  the  attainable  variance  begins  to 
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deviate  from  the  CRLB,  is  positively  identified  by  the  Poisson  approximations. 
This  implies  that  the  GCC  is  an  optimal  estimator  for  high  BT.  The  above  indi¬ 
cations  are  in  agreement  with  conclusions  drawn  from  a  local  (small  error) 
analysis  of  estimator  variance,  undertaken  by  Ianniello  et.  al.  for  bandpass  signals 
[10]. 


II.  Problem  Statement 

We  briefly  recall  the  setting  of  the  two  sensor  passive  time  delay  estimation 
problem  defined  in  Chapters  2  and  3.  Available  are  the  outputs  of  two  sensors, 
*i(<)  and  x2(t),  over  an  interval  of  time  t  €  [0,  T\.  xx{t)  contains  a  signal,  s{t), 
while  x2{t)  contains  a  delayed  version  s(t-D0).  Both  signal  components  are 
observed  in  additive  mutually  uncorrelated  broadband  noises,  nt(f)  and  n2(<). 
We  assume  that  s(t),  n^f),  and  n2(/)  are  ergodic,  zero  mean,  stationary  Gaussian 
random  processes  possessing  spectral  densities  G„  (w),Gnl(w)  and  Gn2(o;)  respec¬ 
tively.  In  addition  D0  £  \-Dm ,  Dm  ],  some  a  priori  region  of  delay.  The  signal 
auto-correlation,  R„  ( r )  =  E[s(f)s(f-r)],  is  assumed  to  be  essentially  zero  for 
M  >  Te  ,  the  correlation  time  of  the  signal,  which  is  also  the  independence  time 
for  the  present  case.  This  implies  that  the  auto  and  cross-correlation  functions  of 
the  observations,  R,y(r)  =  E[x,-  (t)xj  (<-r)J,  are  non-zero  over  at  most  a  distance 
Te  from  the  time  origin. 

The  cross-correlation  estimate  of  time  delay,  D,  is  the  location  in  time, 
within  [~Dm  ,Dm],  at  which  the  absolute  maximum  of  the  (coherent  or 
incoherent)  sample  cross-correlation  function  occurs.  By  ergodicity  the  sample 
cross-correlation,  R  12(r),  converges  to  the  true  cross-correlation, 
R  I2(r)  =  (r~A>  )>  in  ^e  limit  of  large  observation  time,  T.  For  finite  T, 

however,  R  12(r)  may  not  have  its  absolute  maximum  at  D0 .  Recall,  from 
Chapter  2  Eq.  (5),  the  sample  cross-correlation  can  be  expressed  as  the  sum  of 
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signal  type  terms  and  noise  type  terms 

R  ,2(t)  =  R„  (t-D0  )  +  Rn  (r)  (1) 

The  first  term  in  (1)  is  uniquely  dependent  on  the  signal  and  has  an  absolute 
maximum  at  D0 .  The  second  term  represents  a  zero-mean  noise  in  what  can  be 
called  the  cross-spectral  domain  in  contrast  to  the  domain  of  the  observations, 
Eq.  (1)  of  Chapter  1.  This  term,  Rn  (r),  masks  the  global  peak  at  D0  of 
R„  ( t-D0  )  and  thus  degrades  the  accuracy  of  the  estimator.  For  non-white  sig¬ 
nals  one  can  do  better  by  performing  Generalized  Cross-Correlation  obtained  by 
filtering  the  sample  cross-correlation,  with  a  filter  with  transform  W(w),  to 
resolve  the  peak  at  r  =  D0 .  For  representatives  of  the  GCC  class  see  [lj  or 
Chapter  2.  In  the  following,  only  the  simple  cross-correlation  estimate  will  be 
studied,  that  is  W[w)  =  1  in  the  GCC.  Other  GCC’s  can  be  handled  by  dealing 
with  the  W(u;)-derived  signal  and  noises,  defined  by  the  equivalent  scenario  where 
simple  cross-correlation  of  the  W^u^-derived  observations  yields  the  identical 
GCC  output  as  for  the  original  observations  (Substitute  the  filtered  process 
s(t)*  w+(t)  of  Chapter  3,  Eq.  (3),  for  s(£)  in  the  observation  model  of  Chapter  2, 
Eq.  (1)  ). 

In  general,  the  peak  location  algorithm  involves  quantization  of  R  9  and  a 
global  search  over  \-Dm  ,Dm  ].  Thus  a  resolution  parameter,  e,  related  to  the 
granularity  of  the  quantization,  can  be  associated  with  the  peak  detection  opera¬ 
tion.  This  will  introduce  additional  errors  into  the  cross-correlation  estimate  due 
to  quantization  error. 

The  local  variance  of  the  GCC  is  derived  in  [2]  as  a  result  of  linearizing  the 
first  derivative  of  E \R g  (r)]  in  the  neighborhood  of  D0 .  Consequently  the 
analysis  is  exact  as  long  as  R„,  (r)  does  not  deviate  from  an  inverted  parabola 

d2R„  M 


centered  about  zero  with  maximum  R„  (0)  and  curvature: 


dr 


For 
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the  signals  considered  in  this  chapter  the  above  consideration  implies  that  the 
region  of  linearity  for  the  local  variance  analysis  lies  approximately  between  the 
pair  of  zeros  of  /?„  ( D0 )  which  are  closest  to  D0  (See  Fig.  2.2).  For  a  spectrally 
broadband  signal  s(t),  with  single-sided  bandwidth  B  these  zeros  occur  at 

Da  -  and  D0  +  .  For  a  bandpass  signal,  at  center  frequency  w,  the 

B  B 

7T 

region  of  accuracy  of  the  local  variance  is  delimited  by  D0 - and 


D0  -  — -  (See  Fig.  2.2a  and  Fig.  2.2b  for  an  example  of  a  bandpass  signal  and 

its  envelope  ).  Therefore,  if  the  probability  that  the  error  falls  outside  the  linear 
region  is  high,  the  local  variance  will  give  an  overly  optimistic  indication  of  the 
performance  of  the  GCC.  This  probability  will  be  the  most  critical  in  the 
bandpass  case  because  of  the  high  level  sidelobes  of  R  g  (Fig.  2.2a).  In  the  sequel 
we  will  refer  to  the  "linear  region”,  mentioned  above,  as  the  "small  error  region”, 
and  the  remainder  of  the  a  priori  interval  as  the  "large  error  region”. 

Ianniello  considered  an  approximation  to  the  probability  of  anomaly,  for 
broadband  lowpass  signals,  by  looking  at  the  probability  that  a  number  of  test 
points  on  the  correlation  trajectory  in  the  large  error  region  exceed  the  value  of 
the  trajectory  at  the  true  delay  D0  (3}.  To  make  the  computation  of  the  above 
probability  tractable,  the  maximum  number  of  independent  samples  of  the  corre¬ 
lator  output  were  chosen  as  test  points  and  these  were  assumed  to  be  Gaussian 
distributed.  In  our  notation  there  are  approximately  M  =  2 Dm  /  Te  of  these 
points  (including  the  sample  at  D„ )  and  the  approximation  takes  the  form 

00  (  .  M- 1 

pe  =  1  -  /  <f>{x  ~  a){  $(£*)}  dx  (2) 

-CO  *  ' 


where  a  and  /?  are  constants  involving  SNR  and  the  time  -  bandwidth  product 
BT.  <j>  is  the  standard  univariate  Gaussian  density: 
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^  ~  v^r  ^  2  (3) 

and  $  is  the  Gaussian  distribution  function: 

CO 

$(z)  =  f  (j>{s)ds  (4) 

-00 

/ 

Equation  (2)  is  only  applicable  when  the  sidelobe  activity  of  the  correlation  func¬ 
tion  is  neglected  and,  in  general,  it  must  be  numerically  evaluated.  The  Correla¬ 
tor  Performance  Estimate  (CPE)  proposed  by  Ianniello  assumes  that  the  peak 
ambiguities  are  uniformly  distributed  over  the  a  priori  interval.  The  resultant 
expression  for  the  CPE  involves  the  approximation  (2)  for  Pt 

CPE  =  Pe^f  +(1  -Pe)varL  (5) 

where  varL  is  the  linear  approximation  to  the  variance  derived  by  Schultheiss  [2]. 

In  the  next  section  the  probability  of  large  error  will  be  approximated  in 
terms  of  level  crossing  probabilities.  Then  in  Section  V  a  variance  approximation 
is  developed  which  can  be  applied  to  situations  where  the  locations  of  ambiguities 
are  distinctly  not  uniform  over  the  a  priori  interval.  These  approximations  will 
be  more  general  than  the  approximations  (2)  and  (5),  since  they  will  be  able  to 
deal  with  both  broadband  and  narrowband  signals  which  may  display  large 
sidelobes. 

HI.  A  Level  Crossing  Interpretation  For  Large  Error 

In  this  section  a  model  for  the  occurence  of  large  errors,  or  peak  ambiguity, 
is  developed.  By  definition  a  peak  ambiguity  occurs  when  the  global  peak  detec¬ 
tion  scheme  indicates  that  the  absolute  maximum  of  the  output  of  the  GCC, 

R g  (r),  resides  outside  of  the  small  error  region  [D0  -8,  D0  +<5],  e.g.  8  =  or 

8  =  — 

2  w, 


for  lowpass  or  bandpass  signal  spectra  of  single  sided  bandwidth,  B/2, 
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and  center  frequency,  w , ,  respectively. 

As  an  approximation  we  will  characterize  the  peak  ambiguity  by  the 
exceedance  of  R 3  (Z>„ )  by  R  3  (r)  outside  of  the  local  region.  This  essentially  con¬ 
siders  R  3  (Dg)  as  a  representative  of  the  entire  correlation  trajectory  within  the 
local  region,  an  approximation  implicit  in  Ianniello’s  estimate  discussed  in  the 
previous  section.  At  worst,  the  effect  of  the  approximation  will  be  to  over¬ 
estimate  the  probability  of  peak  ambiguity.  More  precisely  let  e  be  the  minimum 
magnitude  resolution  of  the  peak  detection  algorithm.  Then  a  large  error  is 
characterized  by  the  event 

(T)  ~  Rg  (A> )  >  t  some  r  G  H5  (6) 

H5  =  {t:t  €  [-Dm  ,  D0  -<5]  U  [D0  +<5,  Dm  ]} 

For  convenience  define  the  ambiguity  process  AR  3  (r)  =  R  3  (r)  -  R  ?  (£>  ).  In 
what  follows  we  will  assume  a.s.  continuity  of  the  ambiguity  process  in  its  time 
argument.  This  will  permit  probability  statements  concerning  the  set  of  time 
samples  {R 3  (t,- )},  for  a  dense  set  of  points  t{ ,  to  carry  over  to  the  entire  con¬ 
tinuous  trajectory  of  R3 .  Define  the  occurence  of  peak  ambiguities  over  some 
set  of  intervals  ©  contained  in  by  Ae=  {AR3  (r)  >  -c  ,  some  r  £  0}  and 
designate  the  left  and  right  intervals  for  <5  >  0 

I  L  =  [-£*„  ,  D,  -«|  (7) 

1 8  ~{D,+S,Dn  1 

Then  the  equation  governing  the  probability  of  getting  a  peak  ambiguity  over 
H$  =  1 1  Ul  r  ,  Pe ,  can  be  written 

P<  =  PiAllUlt)  =  P[AU)  +  P[AU)  -  P{A1l  HAla)  (8) 

Eq.  (8)  can  be  simplified  considerably  under  the  assumptions  of  very  nar¬ 
rowband  or  very  broadband  signal  spectra.  The  following  comments  are  con¬ 
sidered  in  detail  in  the  appendices  (Appendices  A,  B  and  C).  For  sufficiently 
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broadband  signals,  and  8  =  —  ,  6  is  approximately  the  independence  time,  Tc  , 

of  s(t).  In  this  case  the  occurence  of  level  crossings  over  I  L  is  approximately 
independent  of  occurences  in  I  R  ,  and  Eq.  (8)  can  be  expressed  as 

pe  =  f\Au)  +  P[AIg)  -  P[A1l)P{A1s)  (g) 

For  the  signals  and  noises  of  interest  the  finite  dimensional  distributions  of 
R3 ,  ie-  the  distributions  of  {£*(/,•)}&  for  N  =  1,  2,  .  .  .,  depend  only  on  the 
differences  \t{-D0\.  In  Appendix  B  it  is  shown  that  as  a  result  of  this  shift 
invariance,  the  probability  of  peak  ambiguity  is  not  dependent  on  the  actual 
value  of  D0  if  Dm  is  large  with  respect  to  Te  .  Without  any  loss  in  generality  we 
will  take  D0  =  0.  Then  IL  and  IR  are  of  equal  length  and  P{Ail)  is  equal  to 
P[A\  t)  ,  due  to  the  symmetry  of  the  statistics  of  R3  (r)  about  r=  0.  In  this 
case  Eq.  (9)  becomes 

P,  =F\AU)\2-P[AU)\  ,  I  i  =[-/>„, -^  ]  (10) 

For  narrowband  signals  it  is  shown  in  the  appendices  that,  for  spectra  of 
interest,  a  positive  correlation  exists  between  R  3  (r)  and  R  3  (-r)  when  r  is  in  the 
neighborhood  of  an  ambiguity  prone  sidelobe  of  Rlt .  Therefore  it  is  reasonable 
to  make  the  approximation 

n  AIj)  =  p(Ali)  (ii) 

That  is  a  peak  ambiguity  in  I  ^  implies,  with  high  probability,  that  one  occurs  in 
I  R  .  Hence  for  narrowband  signals  we  will  use 

P<  (12) 

2?r 

where  for  the  lowpass  case,  I  L  =  [ -Dm ,  — ],  and  for  the  bandpass  case, 

7T 

=  [~Pm  >  -  ]•  The  representations  (10)  and  (12)  allows  us  to  restrict 

Jd  tVM 
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attention  to  the  single  interval  IL  ,  which  will  be  done  in  the  sequel. 

If  we  assign  a  direction  of  pursuit  to  the  trajectory  A R 9  (r)  over  I  =  IL 
then  an  equivalence  can  be  drawn  between  peak  ambiguities  and  level  crossings 
of  e  by  A R9  .  We  will  let  A R  9  (r)  trace  out  a  path  as  its  time  argument  increases 
from  -Dm  to  -8.  Define  the  cumulative  distribution  of  A R 9  (r)  at  r  =  t 

F\a;t)  =  P{AR  9  (f)  <  a)  (13) 

Then  the  probability  that  an  ambiguity  occurs  in  I  can  be  written 

P[A, )  =  P[A,  |AJ?  » {-Dm  )  <  -€)F{  -£;-Z>„  )  (14) 

+  P[A,  |A R •  (-Dm  )  >  -€)(l-fl(  ) 

Where  P{A\B)  denotes  the  conditional  probability  of  event  A  given  event  B. 

A  simplification  of  Eq.  (14)  is  immediate.  The  conditional  probability 
P[Aj  |Ai?  g  (- Dm  )  >  -<)  is  equal  to  one  by  definition.  Rewrite  Eq.  (14)  with  the 
above  fact 


P[A, )  =  P{A,  | A R 9  (~Dm  )  <  -e)F[-€--Dm  )  +  1  -  F[~^-Dm  )  (15) 


Fix  8  >  0,  and  define  the  upcrossing  count  process  associated  with  A R  9 


«M  =  { 


number  of  times  A R  9  upcrosses 
-€  in  an  interval  J  £  H $ 


(16) 


Given  A R  9  started  its  trajectory  below  -c,  N( I )  must  be  greater  than  zero  for 
an  ambiguity  to  have  occured  in  I.  Since  the  converse  is  also  true  we  can  write 

PiAj )  =  Pc  (N( I)  >  0)  F  (-c;-Dm  )  +  1  -  F  H;-Dm  )  (17) 

where  Pe  (B)  =  P[B  \  AR  9  ( -Dm )  <  -c). 

Using  Eq.  (17)  in  Eq.  (10)  or  Eq.  (12)  gives  an  explicit  relation  between 
upcrossing  probabilities  and  peak  ambiguity  probabilities.  Thus  the  determina¬ 
tion  of  the  probability  of  large  error  is  reduced  to  solving  for  a  level  crossing  pro¬ 
bability.  Unfortunately  the  distribution  of  level  crossings  is  unknown  explicitly 
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except  for  certain  classes  of  Markov  and  pseudo-Markov  processes  [11]. 
Motivated  by  the  results  on  the  asymptotic  distributions  of  level  crossing  proba¬ 
bilities  in  Chapter  4,  an  approximation  to  Pe  (N{1)  >  0)  will  be  applied,  based  on 
an  inhomogeneous  Poisson  model.  In  addition  to  yielding  approximations  to  the 
peak  ambiguity  probability,  the  Poisson  characterization  will  allow  a  simple 
expression  for  the  global  variance  of  the  time  delay  estimate  to  be  derived, 
involving  moments  of  the  intensity  function  of  the  upcrossing  count  process  N. 

The  next  section  is  concerned  with  the  distribution  of  the  event  N  >  0. 
Section  V  will  contain  the  ensuing  derivation  of  variance,  and  in  Section  VI 
specific  expressions  for  the  conditional  rate  function  (first  moment  of  N)  are 
derived  under  suitable  distributional  assumptions  on  R  3  . 

IV.  The  distribution  of  N 

In  what  follows  we  will  consider  the  large  error  interval  of  interest,  I,  to  be 
[t0 ,/]  for  notational  simplicity,  e.g.  [*„  ,  t ]  =  [~Dm  ,  -5].  Drop  the  reference  to  the 
interval  I  in  the  notation  for  the  number  of  upcrossings  of  -£  by  A R  3  over  the 
interval  I,  N[ I ).  Now  define  the  conditional  expectation  of  the  k-th  factorial  pro¬ 
duct  of  N  given  A R  3  <  -e 

Pk  =  E4  [N[N-l)...{N-k+l)\  (18) 

The  fit ’s  are  commonly  termed  the  factorial  moments  (conditional  here)  of  N. 
Assume  is  finite  for  all  k  and  absolutely  continuous  with  respect  to  intervals 
of  time.  Then  it  is  stated  in  [16]  that  the  (conditional)  probability  that  N  is 
greater  than  zero  obeys  the  exact  relation 

o°  (3l) 

PC(N>  0)  =  2  (19) 

k—1  K‘ 

where  j3'k  is  the  derivative  of  /?*  .  In  particular  f)[  is  the  conditional  intensity 
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\e  of  N,  or  with  N[t)  the  notation  for  N[t9  ,t) 


x.w-A'-^sgWl 

Since  Xe  (7)  A  is  the  expected  number  of 
length  A,  the  conditional  intensity  has  the 
of  upcrossings  per  unit  time. 


•  ,  re  [t0,t]  (20) 

upcrossings  over  a  small  interval  of 
interpretation  of  the  average  number 


It  is  to  be  expected  from  Eq.  (19)  that  \e  plays  a  major  role  in  determining 
the  probability  of  upcrossings.  Indeed,  it  was  shown  in  the  previous  chapter  that 
under  certain  conditions  (Leadbetter’s  conditions  given  in  Chapter  4  ,  Eqs.  (6)  - 
(8)  )  the  (conditional)  probability 


p{t)  =  Pe  (N(t)  >  0) 


(21) 


satisfies  the  integral  equation 


t 


Pi*)  =  JK  (T)(l  -  p(r))dr  +  Q{t) 

t. 


Q(t)  in  (22)  is  given  by 


(22) 


Q[t)  =  lim  2  <](*>)  (23) 

,=o 

(24) 

^i)  =  ,ti+l)> 0,  N(t{  )=0)  -  PiN{t;  ,ti+l)>0)P[N{ti  )=0) 


2* 

Here  Vi  },-o  is  an  increasingly  dense  partition  of  the  interval  [t9  ,t).  In  Chapter 
4  it  was  shown  that  the  (conditional)  intensity  is  given  by  the  integral 


OO 

K  (r)  =  /  z  p  ^(0 ,z)dz  (25) 

o 

where  p  r  is  given  in  Appendix  E  as  the  limit  of  a  function  of  the  three- 
dimensional  density  of  AR 1  (This  limit  is  the  (conditional)  joint  density  of 
A R  g  (r)  and  dAR  g  /dr  if  the  derivative  exists). 
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In  Chapter  4  we  went  on  to  show  that  if  the  possibly  non-stationary  process 
A R 9  is  uniform  mixing;  the  present  becomes  independent  from  the  past  rather 
quickly,  and  the  upcrossings  are  made  rare  in  a  specific  sense,  then  the  distribu¬ 
tion  of  a  normalized  version  of  the  number  of  upcrossings  converges  to  the  Pois¬ 
son  law.  That  is,  let  N  *  be  a  Poisson  counting  process  with  the  identical  (condi¬ 
tional)  intensity  as  N  (conditioned  on  A R  9  (t0 )  <  -e).  The  probability  of  get¬ 
ting  k  points  in  the  interval  of  interest  by  this  Poisson  process  is 


P(JV'(f)  =  *)  = 


/Xe(r)4i 


*! 


t 

exp{-/Xe  (r)rfr> 


t. 


(26) 


t 

The  integral  J  Xc  (r)dr  =  Ee  [iV]  is  commonly  referred  to  as  the  (conditional) 
t. 

rate  function  of  the  point  process  N. 

The  asymptotic  result  mentioned  above  asserts  that  p(t),  Eq.  (21),  converges 
to  p  *(f),  the  probability  of  getting  at  least  one  point  by  N  *  in  [£„ ,/] 

r 

p  '  (r)  =  1  -  exp{  -/  Xe  {o)dc}  (27) 

t. 


As  a  practical  tool  the  above  asymptotic  result  is  unsatisfactory,  in  so  far  as 
the  approximation  of  p(t)  by  p  *  (t)  is  concerned,  since  it  gives  no  indication  of  the 
agreement  between  the  Poisson  and  the  actual  probability  for  finite  observation 
time.  However,  Lemma  2.2  of  Chapter  4  states  that  the  difference  between  the 
Poisson  and  the  actual  upcrossing  probabilities  satisfies 

t 

I  p(t)  -  P  '(01  <  Qi 0  exp(f  h{T)dT)  (28) 

o 

Now  §(t),  Eq.  (23),  is  a  measure  of  the  dependency  of  the  present  on  the  past  of 
the  random  process.  Thus  if  the  upcrossing  process  N[<t,u)  has  little  dependence 
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on 

N(u,v)  where  [<7,i/]  and  («,v|  are  intervals  separated  by  a  finite  distance,  the  error, 
upper  bounded  by  Eq.  (28),  is  arguably  small. 

By  using  the  definition 

00 

E.W=  £  P .  (AT  =  k)  (29) 

1 

we  have  the  result  that  for  any  count  process  N 

Pe  (N  >  0)  <  Ee  [N]  (30) 

so  that  the  difference  |  p(t)  -  p  *(/)|  satisfies 

|p(0-p*(0l  <Ee[iV(0]  (31) 

Hence  at  the  very  least  the  approximation  of  p{t)  by  p ' (t)  is  indicative  of  the 
SNR  region  where  the  ambiguity  error  must  be  small.  Indeed,  ,  in  Sections  VII 
VUI,  it  will  be  seen  that  the  conditional  rate  function,  and  hence  p  *  (t),  under¬ 
goes  a  rapid  increase  from  zero  as  the  input  SNR  ,  relative  to  the  observations, 
Chapter  2  Eq.  (1),  decreases  beyond  a  certain  threshold.  In  Section  Vm  it  is 
observed  that  this  threshold  agrees  with  the  experimentally  observed  threshold, 
for  a  specific  broadband  signal  spectrum,  beyond  which  the  variance  of  the  time 
delay  estimate  deteriorates. 

However  one  must  take  into  account  an  aspect  of  the  Poisson  model  for  the 
upcrossings  which  may  cause  overly  pessimistic  predictions  of  system  perfor¬ 
mance.  It  is  conjectured  that  the  inaccuracy  of  the  independent  increment 
assumption  neccessary  to  send  Q{t)  to  zero,  in  (28),  results  in  under-estimation  of 
the  conditional  variance  of  N,  even  though  N*  has  the  identical  conditional 
mean  as  N.  This  can  be  shown  straightforwardly  for  the  unconditioned  mean 
E[7V],  for  flat  broadband  lowpass  signal  spectra,  by  demonstrating  that  var{jV]  is 
lower  bounded  by  E[NJ.  This  is  not  essential  for  the  following  development  and 
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the  proof  is  omitted.  Since  the  variance  of  the  Poisson  process  with  mean  E[7V] 
achieves  the  lower  bound,  the  Poisson  model  can  be  viewed  as  that  model, 
matching  N  in  mean,  which  minimizes  the  variance  over  all  other  such  models. 
Keeping  in  mind  that  P[N  =  0)  is  the  quantity  of  interest  here,  the  Poisson 
model  entails  a  more  rapid  decrease  in  P{N  =  0),  as  E[7VJ  increases,  than  would 
normally  be  the  case.  Hence  P{N  >  0)  is  over-estimated  by  P[N*  >0). 

In  Section  VIII  the  performance  of  a  modification  of  the  Poisson  approxima¬ 
tion,  acheived  through  a  simple  normalization  of  Xe ,  will  be  investigated  and 
shown  to  be  in  better  agreement  with  experiment  for  broadband  signals  than  the 
Poisson  approximation  presented  above.  For  broadband  signals  of  one  sided 
bandwidth  B0  Hz  ,  a  downward  correction  of  the  intensity  function  is  made  by 
division  of  Xe  by  \fB^.  This  has  a  smoothing  effect  on  the  transition  of  p  ‘  (t), 
Eq.  (27),  as  E,.  [A/]  increases  from  zero.  The  divisor  was  initially  motivated  by  a 
numerical  comparison  of  the  Poisson  approximation  with  Ianniello’s  approxima¬ 
tion  to  the  probability  of  anomaly,  for  large  BT.  However,  the  above  modifica¬ 
tion  can  be  regarded  as  assuming  the  following  specific  form  for  the  correction 
term,  q(r)  in  (23)  and  (24) 

<?(r)  =  (77-  -  1  )*e  (r)(l  -  p(r))  (32) 

Recall,  q(t)  characterizes  the  deviation  of  p{t)  =  Pc  {N[t0  ,t)  >  0)  from  the  Pois¬ 
son  approximation  p  *  (t).  In  general,  at  very  low  SNR  and  high  BT,  the  condi¬ 
tional  intensity  becomes  uniformly  large  over  the  large  error  region.  This  implies 
that  the  conditional  rate  function  is  much  greater  than  one,  which  forces  the  true 
probability  of  upcrossing,  p(t),  to  be  close  to  unity.  The  Poisson  approximation, 
p  *(f)  also  has  this  behavior.  Likewise  at  high  SNR  the  conditional  rate  is  close 
to  zero,  so  that,  by  (31),  p(t)  and  p*-(f)  have  identical  high  SNR  behavior.  The 
assumed  form  for  q(t)  reflects  the  low  and  high  SNR  agreement  of  the  Poisson 
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approximation  with  the  true  probability  (i.e.  q(t)  ^  0  in  these  cases).  The  factor 
(1  /Ba  -  1)  attenuates  the  increase  in  the  probability  of  ambiguity  as  B0,  and 
thus  Ee  [N\,  increases. 

V.  Expressions  for  Estimator  Variance 

In  the  previous  Section  a  large  error  probability  approximation  was 
motivated,  based  only  on  the  projection  of  the  Poisson  random  variable,  N  * , 
onto  the  Bernoulli  random  variable,  X,  defined  as  the  indicator  function  of  the 
event  N  *  >  0.  That  is  X  =  1,  with  probability  Pe  =  P{N  *  >  0)  and  X  =  0, 
with  probability  1  -  Pe . 

For  the  variance  approximation  we  will  exploit  the  full  structure  of  N* . 
Thus  we  specifically  assume  that  N(t),  the  number  of  upcrossings  of  -e  by  A R  3 
within  [f0,  <],  has  a  conditional  distribution  Pe  (•),  as  in  Eq.  (12),  identical  to  the 
distribution  of  N  *  (t),  Eq.  (14). 

In  what  follows  we  will  use  the  convention  of  denoting  the  total  number  of 
upcrossings  over  the  large  error  region,  H5,  by  N,  whereas  N(I)  and  N{t),  for  /  an 
interval,  t  a  point,  retain  their  usual  definitions,  (16)  and  N(t)  =  N{-Dm  ,t).  Of 
course,  N  —  7V(4  )  +  N(IR )  in  this  notation,  where  IL  and  IR  decompose  Hs 
into  left  and  right  intervals,  as  in  (7). 

Define  for  the  N  peak  ambiguities,  or  points,  occurring  in  the  large  error 
region,  H5 

Uj  =  j  location  of  the  ith  point,  *  =  1,  2,  •  •  •  ,  ivj  (33) 

While  there  may  be  many  ambiguities,  there  can  only  be  a  single  u>{  which 
corresponds  to  the  global  maximum  of  R g .  Given  an  ambiguity  has  occurred, 
we  model  the  global  maximum  of  R 3 ,  D,  as  being  equally  likely  to  fall  on  any 
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one  of  the  «,•  ’s.  That  is 

P[D  £[t,  t  +  A]  |.wf  €[t,  t  +  A],  some  i  =  1,  2,  •  •  •  ,  N)  =  JL  (34) 

Note  the  above  model  restricts  the  location  of  the  ambiguous  peak  of  Z?  ?  to 
lie  within  A  of  one  of  the  upcrossing  points  {w,- }.  This  is  a  good  approximation 
for  large  a  priori  interval-bandwidth  product,  Dm  B,  when  excursions  of  A R  3 
above  -e  are  short  lived  (spurious  peaks). 

Using  the  law  of  total  probability,  we  can  express  the  variance  of  the  time 
delay  estimate  D  as 

vaiiD)  =  var[D  \  D  £  H5)  P[D  £  H{)  (35) 

+  lim  E  («.*  -Dt)2P[De[t{,t{  +A]) 

Here  is  an  increasingly  dense  partition  of  H5  as  A  decreases  to  zero. 

The  conditional  variance,  var{D\D  £  H$),  in  Eq.  (35)  is  equal  to  the  local  variance 
of  the  delay  estimate  derived  in  [2j,  as  long  as  var[D\D  Hs)  <  (P/3,  and  is 
equal  to  62/ 3  otherwise.  For  simplicity  denote  varL  (D)  the  conditional  local  vari¬ 
ance  var(D  |  D  fe  H5). 

Using  the  approximate  independence  of  the  distribution  of  ambiguities  of  D0 
(Appendix  C),  Eq.  (35)  is  equivalent  to 

var(b)  =  varL  (D)  P[D  £  HS)  (36) 

+  lim  £  t,*P[D  6  [(,■,(,■+  A]) 

4  -  0  I.  €  H, 

Using  (33)  we  have 

P[D  €  [f,  t  +  A])  (37) 

CO 

=  E  P{D  £[t,  t  +  A],  u{  E[t,  t  +  A]  some  1  =  1,  •  •  •  ,  k) 

1 

CO  1 

==  E  T  €  1  +  some  *  =  !>  •  •  •  .  k) 

k=~  1  K 


Define  the  composite  intensity  function  pe  (r),  on  H5  =  IL  (J  Ir  ,  where  IL  and 


4  are  the  left  and  right  ambiguity  regions  defined  in  Eq.  (7) 


Pc  (r)  = 


■§;  E.WDm  ,  r)|,  r  S 
E,  [N{Dm  ,  r)|,  r  e  IR 


(38) 


In  (38),  N(—Dm ,  t),  t  <  ,  is  the  notation  for  the  number  of  upcrossings  of  —  e 

by  A R3  in  [r,  Dm  ]  where  Ai??(a)  is  taken  as  tracing  out  its  trajectory  as  s 
decreases  toward  zero.  Thus  Ee  ( N{Dm  ,  r)],  r  G  4  ,  is  the  expected  number  of 
upcrossings  of  this  time  reversed  A R  3  given  A R  3  ( Dm  )  <  -e. 


For  the  GCC  trajectories  of  interest,  the  symmetry  of  the  first  and  second 
order  statistics  of  R 3  about  zero  (see  Appendix  C)  implies  that 
Ee  [iV(-Z>m  ,  r)J  =  Ee  [N{Dm  ,  r)j.  Thus 


(  (r)  >  r  s  4 

Pe  ^  ~  l  (~r)  ,  tE  Ir 


where  Xc  (r)  is  the  conditional  intensity  defined  in  Eq.  (20). 

In  Appendix  H,  it  is  derived  that  (if  pe  is  continuous  at  t  E  H5  ) 
P[^>i  E[t,  t  +  A]  some  »  =  1,  •  •  •  ,  k) 

1  Jt-i 

/  pe  (4* 

h4 


=  Pc(t)  •  A 


exP{-/  Pe  ( s)ds } 
h4 


(k  -  1)! 

Hence  substituting  (40)  into  (37)  and  recognizing  the  identities 


f\N>  0)  =  £  - 


/  Pc  («)* 
H4 


exP{-/  Pc  (4<M 


H4 


E{N}  =  f  pe  (s)ds 

H, 


we  obtain 


(39) 


(40) 


(41) 

(42) 


var(D)  =  varL  (D)  P[N  =  0)+ 


2  Pc  (*>) 


//  E{N) 


ds 


P[N  >  0)  (43) 
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Recognizing  P(N  >  0)  a s  Pt ,  Eq.  (9),  and  using  (39),  we  have  the  equivalent 
expression  for  variance 


-8 

var(D)  =  v arL  (D)  [1  -  Pe  ]+  /  s2  \e  (s)ds  •  Pe 


(44) 


where  we  have  defined  the  normalized  intensity  function 

*  X,  (r) 

W  =  — (45) 

/ 

-Dm 

Eq.  (44)  shows  that  as  the  probability  of  large  error  increases,  one  must  correct 
the  local  variance  by  adding  a  proportionate  amount  of  a  potentially  large  quan¬ 
tity.  This  quantity  can  be  interpreted  as  the  second  moment  of  the  probability 
density  of  ambiguities  over  time,  Xe ,  i.e.  the  mean-square  deviation  of  the  magni¬ 
tude  of  the  large  error. 

In  Section  VIII,  the  Poisscm  variance  approximation  (44)  will  be  implemented 
using  a  time  independent  approximation  to  Xe ,  for  large  Dm  B.  In  this  case  (44) 
becomes 


(D2  +  tf2) 

var(D)  =  varL  (D)  [1  -  Pt  ]+  - - - -  Pe  (46) 

Now  as  the  signal-to-noise  ratio  decreases  to  zero,  one  would  expect  the  vari¬ 
ance  to  correspond  to  the  case  of  uniformly  distributed  random  variable  on 
\-Dm  ,  Dm  ].  Indeed  as  this  SNR  condition  occurs 


P< 


Dm  -s  6 

Dm  ~  Dm 


(47) 


and  from  (46) 


var(D)  —*■ 


(An2  +  P)  (Dm  -  S) 


D„ 


Dn 


+ 


3 


(48) 
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With  8  —  2 ttJB,  it  is  readily  verified  that  (48)  becomes 

vaiiD)  -  f>m2/ 3  +  )  (49) 

which  is  the  expected  result  for  Dm  B  »  1. 

VI.  Explicit  Form  of  the  Average  Number  of  Peak  Ambiguities 

Of  interest  here  is  the  form  of  the  conditional  rate  function  Ee  [TV],  or  the 
time  varying  intensity  function,  \e  (r),  of  the  number  of  upcrossings  TV,  associ¬ 
ated  with  the  ambiguity  process  A  RJ .  \e  is  a  function  of  the  bivariate  distribu¬ 
tions  of  A R  *  conditioned  on  A R  *  ( -Dm  )  <  -€.  The  bivariate  distribution  of 
the  GCC  output,  R  9 ,  is  not  exactly  known  except  for  particularly  simple  cases 
such  as  sinusoidal  signals  and  simple  cross-correlation  operations  [13].  Even  in 
this  simple  situation  the  resultant  expressions  are  cumbersome.  Here  we  will 
assume  that  R  *  is  adequately  characterized  by  Gaussian  statistics.  This  can  be 
justified  if  one  has  a  large  observation  interval  and  implements  segment  averag¬ 
ing  techniques  to  estimate  the  cross-correlation  function.  The  details  are 
relegated  to  Appendix  D. 

In  Appendix  E  it  is  shown  that  if  the  a.s.  continuous  Gaussian  process  AT?  ^ 
satisfies  some  regularity  conditions,  involving  continuity  of  certain  first  order 
derivatives  of  its  covariance  function  and  a  non-degeneracy  condition,  then  the 
conditions  neccessary  for  the  validity  of  (21)  through  (25)  and  (28)  are  satisfied 
for  the  conditioned  process:  AT?*  given  AT? ?  (~Dm  )  <  -c.  Simple  moment  con¬ 
ditions  on  the  observation  spectra  are  given  in  Appendix  F  which  guarantee  the 
above  mentioned  continuity.  In  Appendix  E  the  conditional  intensity  function  of 
the  upcrossings  of  -c  by  AT?  *  (r)  given  AT?  *  (~Dm )  <  -e,  is  derived  as 

OO 

\e(T)  =  K  f  y  ${ay+8)  (f>{y+Q)dy  ,  r  6  [~Dm  ,-8\ 

0 


(50) 
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K,  a,  9  and  ©  are  functions  of  r  given  by  Eqs.  (E.4)  through  (E.10)  in  Proposi¬ 
tion  F.l. 

Unfortunately  the  integral  in  Eq.  (50)  is  not  tabulated  so  that  the  calculation 
of  the  rate  function,  Ee  [A'],  the  integral  of  Xe  over  \-Dm  ,-<5],  involves  a  two- 
dimensional  integration  over  an  infinite  region.  Although  routines  do  exist  to  per¬ 
form  such  calculations  for  this  type  of  integral  [10]  a  simple  approximation  to  Xe 
will  be  presented  in  the  next  Section  involving  only  a  single  integration.  For  pur¬ 
poses  of  comparison,  it  will  be  instructive  to  consider  Eq.  (50)  under  similar 
broadband  assumptions  as  in  [3]. 

For  large  DmB,  and  a  lowpass  signal  spectrum,  it  is  shown  in  Appendix  G 
that  K  and  9  are  approximately  constant,  and  a  and  9  are  approximately  zero, 
over  the  majority  of  [~Dm ,  -<5]  (A  plot  of  a(r)  is  displayed  in  Fig.  6.1  for  a  typical 
lowpass  spectrum).  As  a  consequence,  for  large  Dm  B ,  we  lose  little  accuracy  in 
our  computations  by  using  a  time  independent  approximation  to  the  intensity, 
(50),  in  place  of  the  exact  expression.  Such  an  approximation  is  derived  in 
Appendix  G  for  flat  lowpass  signal  and  noise  spectra  of  magnitudes  S/B  and 
N/B  respectively,  where  B/ 2  is  the  cutoff  frequency  beyond  which  the  spectra 
are  zero. 

Recall  that  the  resolution  parameter,  e,  is  related  to  the  quantization  of  R  9 , 
associated  with  the  peak  searching  operation.  If  e  is  not  zero  then  it  is  clear, 
from  the  development  in  Appendix  G,  that  in  addition  to  involving  SNR  the 
intensity,  (50),  is  also  a  decreasing  function  of  signal  and  noise  power.  The 
interpretation  is  that  resolution  (quantization  error)  depends  on  the  absolute 
magnitude  of  the  GCC  output,  while  the  true  location  of  the  global  peak  only 
depends  on  the  relative  magnitude  (i.e.  it  is  scale  independent).  In  theory  the 
effect  of  e  on  performance  can  be  minimized  by  scaling  up  the  GCC  trajectory 
before  quantization.  In  practice,  however,  scaling  (amplification)  is  not  a 
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distortion  free  operation  and  couid  introduce  additional  error.  Nonetheless,  we 
will  concentrate  on  the  case  where  €  is  zero  in  the  following  discussion. 

The  conditional  rate  function  of  the  upcrossings  is  the  integral  of  the  inten¬ 
sity,  which,  from  (G.54),  is  of  the  form 


Ee  [2V|  =  Xe  (. Dm  -6)  = 


B,  {Dm  S) 

'ft  V2+I712I2 


7  \fi ST? 

>/3+2|7i2|2 

$(7  y/2B7T) 


(51) 


<t>( 7  V^T) 


(Note  in  practice  S«Dm  in  (51))  Here  B0  =  R/4jt  is  the  single  sided  signal 
bandwidth  in  Hz,  (7^2!  is  the  magnitude  coherency 


and  we  have  defined 


|7i2|  = 


S 

S  +  N 


(52) 


|7i2| 

\/2  +  l7i2|2 


(53) 


The  consideration  of  (51)  gives  some  insight  into  the  large  error  performance 
of  the  GCC.  Note  that,  as  expected,  decreasing  the  SNR,  or  equivalently 
decreasing  |712|  and  7  towards  zero,  increases  the  intensity  function,  \c ,  and 
thus  the  probability  of  peak  ambiguity,  Pe .  However  the  rate  of  increase  in  Xc  , 
due  to  decreasing  SNR,  is  determined  by  the  time-bandwidth  product  B0  T  and 
the  a  pnon-interval-bandwidth  product  B0  Dm  .  Specifically,  for  fixed  Dm  ,  B0T 
determines  the  signal- to- noise  ratio  threshold  beyond  which  increasing  SNR  leads 
to  a  rapid  decrease  in  Xe .  In  general,  increasing  B„  T  shifts  this  threshold  to  a 
lower  SNR,  expanding  the  range  of  error  free  operation  of  the  GCC.  On  the 
other  hand,  B0  Dm  affects  the  magnitude  of  the  expected  number  of  upcrossings, 
and  its  rate  of  increase,  as  the  SNR  decreases  beyond  the  threshold.  Increasing 
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the  length  of  the  a  priori  region,  [~Dm  ,  Dm  ],  naturally  makes  large  errors  more 
likely  as  is  indicated  by  the  corresponding  increase  in  Ee  [TV]  of  (51)  The  above 
comments  corroborate  analytical  results  obtained  in  [4]  and  the  generally  ack¬ 
nowledged  practical  performance  of  the  GCC  [3], 

Consider  the  asymptote  of  Ee  [TV]  as  |712|  goes  to  zero.  In  the  limiting  case  , 
from  Eq.  (51) 


E,  (W) 


B.(Dm  -6) 

^6 


(54) 


Ee  [TV]  is  finite  if  Dm  -  6  is  non-zero  so  that  there  is  a  finite  probability  that  no 
large  error  will  occur  even  at  infinitessimally  small  SNR.  This  is  merely  an  effect 
of  the  uniform  distribution  of  the  global  peaks  of  R  g  over  the  a  priori  interval 
when  no  signal  component  is  present  in  the  observations.  Note,  in  general,  the 
probability  of  ambiguity  is  upper  bounded  by  ( Dm  -  6)/Dm ,  the  probability  of 
error  for  an  estimator  which  ignores  the  observations,  generating  random  values 
within  [■ -Dm  ,  Dm\. 


VTI.  The  Unconditioned  Approximation  to  Ee  [TV] 

Section  VI  dealt  with  the  form  of  the  conditioned  rate,  E,.  [TV],  of  the 
upcrossings  of  -e  by  AT?  9  over  \-Dm  ,-<5]  given  AT?  g  ( -Dm  )  <  -e.  Except  for 
large  Dm  B0  ,  where  an  explicit  expression  for  the  conditional  rate  function  can  be 
derived,  the  integral  of  (51),  that  is  Ec  [TV],  (50),  is  difficult  to  evaluate.  Here  we 
will  consider  the  unconditioned  version  of  the  conditional  rate,  E[TV],  which  has  a 
simpler  functional  form  than  (50),  but  remains  a  good  approximation  to  E,.  [TV]. 

Recall,  from  Section  II,  conditioning  of  the  upcrossing  probability  over 
\-Dm  ,-£],  on  the  the  non-exceedance  of  -€  by  AT? g  (~Dm ),  was  necessary  to 
assert  an  equivalence  between  level  crossings  and  peak  ambiguities.  However  the 
difference  between  the  subset  of  realizations  of  T? 9  which  give  peak  ambiguity, 
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that  is  simply  exceed  R  3  (0)-€,  and  those  that  actually  upcross  R  3  (0)-e  is  the 
subset  where  R  3  exceeds  the  above  level  in  the  neighborhood  of  -Dm  and  down- 
crosses  the  level  at  most  once  over  \-Dm  ,-<5].  It  can  be  argued  that  the  probabil¬ 
ity  of  this  latter  event  is  small  when  Dm  is  sufficiently  large.  Essentially,  at  high 
SNR,  any  ambiguities  which  may  occur  are  predisposed  to  occur  near  the 
sidelobes  of  the  cross-correlation  function  (where  the  mean  value  of  R 3 
approaches  the  mean  value  of  R  3  (0)).  On  the  other  hand,  at  low  SNR,  many 
peak  ambiguities  are  likely  to  occur,  so  that  an  upcrossing  must  exist  within 
\-Dm  ,-<5]  regardless  of  the  value  of  R 3  (- Dm  ). 

The  unconditioned  rate  function,  E[iV],  is  derived  in  Reference  [17]  for  a 
non-station  ary  Gaussian  random  process.  The  result  is 

-s 

E[N]  =  /  \(r)dr  (55) 

-Dm 


where  X  is  the  unconditioned  intensity  function  of  N 


HT)  =  (1  “  P?)l/2^  M-p-  )[«H$V)  +  $V*($V)]  (56) 

<rr  ,  <jt  and  pT  are:  the  variance  of  Ai?  3  (t),  the  second  derivative  of  the  variance, 
and  the  first  derivative  of  the  variance  evaluated  at  time  r.  ftT  and  rjT  are  the 
mean  of  A R  3  (7)  and  its  derivative.  is  the  ratio 

<Tr 

Vr  ~  Pr—  (e  +  Pr) 

(1  ~  />r2)1/2OV  ^ 

Again  assume  e  =  0.  An  asymptotic  analysis  of  identical  form  as  that 

applied  to  Xe  and  Ee  [N\  in  Section  VI  to  obtain  Eq.  (51),  gives  the  following 
time  independent  approximation  to  the  unconditioned  rate 


E[N]  =  \(Dm 


-6)  = 


B0  ( An  -  6) 


v^0(V  VWt) 


v^'\/  2_*“lTr12|2 


(58) 
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where  |712|,  7  and  B0  are  defined  as  in  Eq.  (51).  The  unconditional  approxima¬ 
tion  and  the  true  rate  function,  Eq.  (58)  and  Eq.  (51),  differ  only  in  the  absence, 
in  (51),  of  the  ratio  $(ax)/$(x),  with  a  =  y/2+\ql2\2  and  x  =  7  y/ Wg  T.  This 
ratio  is  essentially  unity  for  large  and  small  SNR  (  7  sJW„  T  ),  which  is  con¬ 
sistent  with  the  argument  at  the  beginning  of  this  section  concerning  the  accu¬ 
racy  of  the  approximation  of  Ee  [N\  by  E[N].  For  comparison,  plots  of  the  rate 
function,  E{jV),  and  the  conditional  rate  function,  Ee  [N\,  are  displayed  in  Fig.  8.1 
for  B0  =  200 Hz  B9  =  100  Hz.  and  B0  =  50  Hz  for 

An  —  0.125sec.,  T  =  Ssecs.  The  unconditional  approximation  is  uniformly 
larger  than  the  quantity  it  is  attempting  to  estimate,  i.e.  (51).  This  indicates 
that,  at  least  for  large  Dm  B,  at  worst,  the  Poisson  probability  approximation, 
using  (56)  in  place  of  (50),  will  over-estimate  the  nominal  approximation,  using 
(50),  below  the  SNR  threshold. 

In  the  next  section  the  unconditional  rate  of  (55)  is  used  in  place  of  the  con¬ 
ditional  rate  of  (50)  to  numerically  evaluate  the  ambiguity  probability  and  error 
variance  approximations,  obtained  by  applying  the  Poisson  approximation  to  the 
conditional  probability  of  upcrossings,  discussed  in  Sections  IV  and  V.  For  refer¬ 
ence  we  display  the  specific  approximation  to  the  probability  of  ambiguity,  Pt  of 
(10)  and  (12),  for  broadband  and  narrowband  signal  spectra  respectively 

Pe  =  P[Ah  )(2  -  P[Ah ))  (59) 

and 

A  =  P[Ah )  (60) 

P{Ajl )  is  the  probability  that  an  ambiguity  occurs  over  the  interval 

4  =  [~Dm  ,<5]-  This  is  a  function  of  the  conditional  probability  of  upcrossings, 

Pc  {AIl  ),  (see  Eq.  (17))  which  we  replace  by  the  Poisson  approximation,  p  *(f)  of 

(27),  with  X  replacing  Xe ,  (Note  we  use  in  (27):  ,f]  =  [~Dm  ,-<$]): 
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P[^k )  =  (1  -  exp{-E[N]}).P(A.R*  (~Dm )  <  0)  +  1  -  P[AR  9  (~Dm )  <  0)(61) 
where 

P(AJ?»(-^)<0)  =  *(-±M  )  (62, 

Eqs.  (59)-(61)  will  be  referred  to  in  the  next  section  as  the  "Poisson  probability 
approximations”  and  the  variance  obtained  by  substitution  of  Pe  into  Eq.  (44), 
will  be  the  "Poisson  variance  approximation”. 

VIII.  Numerical  Study 

Here  plots  of  the  unconditioned  intensity,  Eq.  (56),  the  rate  function,  Eq. 
(55),  the  Poisson  probability  approximations,  Eqs.  (59)-(61),  and  the  Poisson 
variance  approximation,  Eq.  (44),  are  investigated  for  broadband  and  narrowband 
spectra.  First  we  consider  the  case  of  broadband  lowpass  signal  spectra  with 
large  BT.  For  this  case  we  use,  as  a  benchmark  for  comparison,  the  specific  sig¬ 
nal  and  observation  parameters  as  were  used  in  [14].  For  the  example  in  [14]  we 
plot  the  intensity  surface  as  a  function  of  time  and  SNR  to  gain  some  insight  into 
the  distribution  of  large  errors  over  the  a  priori  region  of  delay.  Next  curves  for 
the  rate  function  of  ambiguity  and  the  resultant  Poisson  approximations  are 
displayed,  and  the  probability  of  large  error  is  compared  against  lanniello’s 
approximation,  (2).  Also  displayed  is  the  corrected  Poisson  approximation,  dis¬ 
cussed  in  Section  IV,  designed  to  compensate  for  the  Poisson  models  tendency  to 
over-estimate  the  peak  ambiguity  probability.  For  comparison,  the  results  of  a 
simulation  of  estimator  performance,  undertaken  in  [14],  is  plotted  alongside  of 
the  Poisson  variance  approximation.  Finally  narrowband  signal  spectra  are  con¬ 
sidered.  The  intensity  surface  of  the  ambiguities  is  generated  and  compared  to 
that  generated  for  lowpass  signal  spectra.  Then,  based  on  plots  of  the  rate  func¬ 
tion,  the  influences  on  performance  of  center  frequency,  bandwidth,  observation 
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time  and  a  priori  interval  are  studied.  The  Poisson  probability  and  variance 
approximations  are  investigated  and  the  indicated  SNR  threshold  values  are  com¬ 
pared  to  the  predictions  of  [18],  which  were  obtained  by  the  Ziv-Zakai  bound. 

Fig.  8.2  is  a  plot  of  the  intensity  surface  as  a  function  of  input  SNR  and 
time  for  a  flat  lowpass  signal  spectrum  of  single  sided  bandwidth,  B0  =  100 Hz. 
The  observation  time  was  set  to  T=8secs.  The  time  window  displayed  in  the  fig¬ 
ures  extends  across  the  first  few  sidelobes  of  the  auto-correlation  function  of  the 
signal,  starting  at  S  =  1/2 B„  (at  the  north-east  corner  of  Fig.  8.2  for  a  SNR  of 
OdB).  In  the  figure,  the  global  maximum  of  the  signal  auto-correlation  function 
lies  beyond  the  rightmost  point  on  the  t  axis.  Note  the  abrupt  increase  of  the 
intensity  near  the  SNR  threshold  indicated  by  SNRt  on  Fig.  8.2.  At  low  SNR 
the  intensity  surface  saturates  (average  height  is  about  4.2  ambiguities  per  unit 
time)  with  only  a  small  ripple  over  time.  For  high  SNR  the  intensity  is  essentially 
zero  uniformly  over  the  time  window.  These  correspond  to  the  cases  when  the 
uniform  distribution  of  peak  ambiguities  over  the  a  priori  region  is  an  accurate 
approximation.  That  is,  when  Ianniello’s  approximation,  (2),  and  the  asymptotic 
forms  of  the  intensity,  (51)  and  (58),  are  strictly  accurate.  However  in  the  ” ambi¬ 
guity  dominated”  region  of  SNR  (  approximately  -8dB  to  -20dB),  ambiguity 
occurs  more  frequently  in  the  neighborhoods  of  the  local  maxima  of  the  signal 
auto-correlation . 

In  Fig.  8.3  the  normalized  difference  between  the  rate  function  computed 
from  X(r),  (56),  and  the  time  independent  approximation  to  X(r)  ,  X  of  (58), 

-S 

MA»  -«)-  /  X(r)</r 

difference  = - — - - -  (63) 

/  M r)dr 

1  -A, 

is  displayed  for  lowpass  signals  with  B0  =  100 Hz,  T  =  8seca.  and  Dm  =  0.125 
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and  0.02  seconds  respectively.  Note  the  above  choices  for  Dm  represent  an  a 
pn'on-interval-bandwidth  product  of  12.5  and  2  respectively.  It  is  evident  from 
Fig.  8.3  that  only  a  small  error  is  incurred  for  the  larger  of  the  Dm  B0  products, 
the  error  increasing  as  Dm  B0  becomes  small  (in  which  case  the  GCC  trajectory  is 
increasingly  dominated  by  the  signal  auto-correlation  sidelobe  activity  over  the  a 
priori  region).  The  above  observations  provide  evidence  for  the  fact  that  under 
the  uniform  assumption  the  accuracy  of  probability  statements,  concerning  the 
number  of  ambiguities  over  {— Dm is  determined  by  the  a  priori-interval- 
bandwidth  product,  Dm  B0 

Next  we  investigate  the  Poisson  motivated  approximations  to  the  probability 
of  peak  ambiguity  and  estimator  variance,  discussed  in  Sections  VI,  Eq.  (59)  and 
(61),  and  V,  Eq.  (44),  ,  for  simple  flat  lowpass  signal  spectra  as  above.  The 
approximation  to  Pe  of  (59)  is  plotted  in  Figs.  8.4,  8.5  and  8.6  against  Ianniello’s 
formula,  (2),  as  a  function  of  input  SNR  for  B„  =  50 Hz,  B0  =  100 Hz,  and 
B0  =  600 Hz  respectively,  and  T  =  8sec3.,  Dm  =  0.125secs.  Also  plotted  is  the 
corrected  version  of  the  Poisson  probability  approximation  discussed  in  Section 
IV.  The  Poisson  probability  approximation  over-estimates  the  ambiguity  proba¬ 
bility  within  the  regions  -6 dB  to  -30 dB,  -8 dB  to  -30  dB  and  -12  dB  to  -20  dB  for 
B<>  =  50 Hz,B0  —  100 Hz  and  B0  =  600 Hz  respectively.  The  error  in  the  Pois¬ 
son  approximation  is  most  severe  near  the  knee  of  Ianniello’s  curve  and  increases 
as  B0  decreases.  This  is  in  agreement  with  the  comments  on  the  behavior  of  the 
Poisson  approximation  at  the  end  of  Section  IV.  Note,  however,  that  the  Poisson 
model  gives  good  approximations  to  the  locations  of  the  SNR  thresholds,  which 
are  within  2dB  of  those  indicated  by  Ianniello’s  approximation.  The  corrected 
Poisson,  implemented  using  Ee  [N\/y/B^  in  place  of  E,  [N],  in  Eqs.  (27),  (14)  and 
(10),  gives  better  agreement  with  Ianniello’s  probability  approximation  as  is  indi¬ 
cated  in  Figs.  8.4  through  8.6. 
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In  Fig.  8.7  the  variance  approximation  of  Section  V  is  compared  to  the 
CRLB  (local  variance  of  [2]),  and  to  the  simulated  variances  calculated  in  [14], 
using  the  Poisson  and  corrected  Poisson  approximations,  for 
Bg  =  100 Hz,  T  —  89ecs.,  and  Dm  =  0.125secs.  The  Poisson  approximations 
agree  with  the  CRLB  above  a  SNR  of  about  -6dB.  However,  as  the  SNR  falls 
below  this  threshold,  the  Poisson  approximations  indicate  a  much  higher  variance 
than  that  indicated  by  the  CRLB.  This  is  the  ambiguity  dominated  region, 
where  the  CRLB  fails  to  govern  the  performance  of  the  GCC.  Note  that  the  gen¬ 
eral  behavior  of  the  Poisson  approximations  agree  well  with  the  simulated  perfor¬ 
mance.  However,  the  nominal  Poisson  approximation  gives  variance  predictions 
which  are  somewhat  conservative  over  the  threshold  region,  -6 dB  to  -15 dB,  while 
the  corrected  Poisson  model  for  the  variance  is  closer,  on  the  average,  to  experi¬ 
ment. 

Figs.  8.8  through  8.18  relate  to  the  bandpass  signal  spectra.  General  com¬ 
ments  concerning  the  Poisson  approximations  are  as  follows.  For  the  bandpass 
case,  the  auto-correlation  of  the  signal  has  a  very  narrow  peak  (lobe)  at  the  ori¬ 
gin.  Therefore,  at  high  SNR  the  estimate  of  the  location  of  this  peak  is  highly 
accurate  (for  high  BT),  much  more  so  than  for  the  lowpass  case,  as  is  predicted 
by  the  CRLB.  However  while  the  local  variance  indicates  a  basically  log  linear 
decrease  in  performance  as  the  SNR  decreases,  the  Poisson  approximation  reveals 
the  SNR  thresholds  discussed  by  Weiss  and  Weinstein  in  [18]  which  are  ignored 
by  the  local  variance. 

In  Fig.  8.8  the  intensity  surface,  as  a  function  of  time  and  SNR,  is  displayed 
for  a  bandpass  signal  at  center  frequency  f0  =  500 Hz,  with  one  sided  bandwidth 
B0  =  100 Hz,  and  T  =  8.0secs.  Here  the  time  interval  extends  from  the  first 
zero  crossing  of  the  auto-correlation  function  of  the  signal,  6  =  1/4 f0  ,  to  approxi¬ 
mately  the  fifth  sidelobe  away  from  the  origin.  Fig.  8.8  is  oriented  identically  to 
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Fig.  8.2  for  the  lowpass  case  ,  i.e.  the  global  maximum  of  the  autocorrelation  is 
beyond  the  rightmost  point  on  the  t  axis.  Contrasting  Fig.  8.8  with  Fig.  8.2  it  is 
evident  that  the  variation  in  the  intensity  surface  over  time  is  much  more  severe 
in  the  bandpass  case,  even  at  low  SNR.  In  fact  the  average  number  of  ambigui¬ 
ties  is  orders  of  magnitude  greater  near  the  first  sidelobe  than  over  the  rest  of  the 
time  axis.  A  distinctive  feature  of  Fig.  8.8  is  the  SNR  difference  between  the 
point,  SNR  j  where  a  rapid  rise  in  the  intensity  of  ambiguity  first  begins,  i.e.  in 
the  region  of  the  first  sidelobe,  and  the  point,  SNR  2  where  a  uniform  increase  of 
the  ambiguity,  over  time,  is  in  evidence.  This  implies  the  existence  of  at  least 
two  separate  SNR  thresholds  in  the  bandpass  case. 

In  [18]  four  distinct  regions  of  performance  were  discovered  based  on  a  study 
of  the  Ziv-Zakai  lower  bound.  These  regions  are  delineated  by  two  SNR  thres¬ 
holds,  SNR  j  and  SNR  2,  and  a  SNR  point,  SNR  2  ,  beyond  which  only  a  priori 
information  is  useful.  The  Ziv-Zakai  bound  can  be  loosely  interpreted  as  govern¬ 
ing  the  performance  of  the  optimal  estimator  of  delay  (The  bound,  however,  is 
generally  unattainable).  In  light  of  the  present  results,  displayed  in  Fig.  8.8,  a 
physical  explanation  of  the  thresholds  can  be  proposed.  It  may  be  helpful  to 
refer  to  Fig.  2.2a  and  Fig.  2.2b  in  interpreting  the  following  comments.  For  SNR 
larger  than  SNR  j,  the  only  significant  source  of  errors  comes  from  small  varia¬ 
tions  in  the  maximum  of  the  narrow  peak,  which  occurs  at  the  true  delay.  As  the 
SNR  approaches  SNR  lf  however,  a  rapid  increase  in  the  error  occurs,  due  to  the 
proximity  of  the  maxima  of  the  closely  spaced  high  frequency  sidelobes  of  the  sig¬ 
nal  auto-correlation.  Due  to  the  rapid  attenuation  of  the  high  frequency  com¬ 
ponent  by  the  auto-correlation  envelope,  Fig.  2.3b,  an  initial  saturation  of  the 
errors  occurs  within  the  central  lobe  of  the  envelope  as  the  SNR  approaches 
SNR  2.  The  occurrence  of  additional  large  errors,  over  the  outlying  remainder  of 
the  a  priori  interval,  is  precluded  until  a  sufficiently  low  second  threshold  is 
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attained,  SNR2 •  Beyond  SNR2,  the  outlying  ambiguity  becomes  as  significant  as 
that  falling  within  the  central  lobe  of  the  envelope,  and  the  error  begins  a  second 
period  of  rapid  increase.  This  increase  continues  until  total  saturation  of  the  a 
priori  interval  is  achieved  at  SNR3.  Beyond  SNRZ,  a  limit  on  the  number  of 
ambiguities  is  imposed  by  the  maximum  number  of  times  a  waveform,  of  finite 
bandwidth  B0 ,  can  undergo  zero  crossings  within  the  a  priori  region.  While 
SNR  3  is  not  really  a  threshold  in  the  sense  of  SNR2  and  SNR ,,  in  the  following 
we  will  refer  to  all  three  as  SNR  thresholds,  for  ease  in  presentation. 

The  remaining  figures  indicate  the  influence  of  the  parameters  B0 ,  f0 ,  T 
and  Dm  on  the  three  quantities:  the  rate  function  of  peak  ambiguity,  and  the 
Poisson  probability  and  variance  approximations.  In  Fig.  8.9  a  table  of  values  of 
the  thresholds,  SNR  3,  SNR  2  and  SNR  |,  predicted  by  the  theoretical  analysis  of 
the  Ziv-Zakai  lower  bound  [18  Eqs.  (62),  (72)  and  (73)]  is  presented  for  com¬ 
parison  with  the  thresholds  indicated  by  the  Poisson  approximation  in  Figs.  8.12, 
8.15,  and  8.18. 

In  Fig.  8.10  through  Fig.  8.12  the  above  three  quantities  are  plotted  as  a 
function  of  SNR,  for  fixed  parameters:  f0  =  2000 Hz,  T  =  8.0secs.  and 
Dm  =  0.125aeca.  and  varying  bandwidth:  B0  =  100 Hz  and  500 Hz.  In  addition, 
in  Fig.  8.12  the  CRLB  is  plotted  for  comparison.  We  note  the  following  features. 
An  increase  in  B0  entails  a  decrease  in  the  rate  function  of  ambiguity  and  a 
decrease  in  the  initial  SNR  threshold  SNR  v  At  low  SNR,  the  steady  state  mag¬ 
nitude  of  the  rate  function  does  not  significantly  vary  over  the  two  bandwidths. 
For  B0  =  500 Hz  (BT=4000),  as  we  increase  the  SNR  the  variance  approxima¬ 
tion  joins  the  CRLB  at  SNR  *=»  -6 dB.  However,  for  B0  =  100 Hz  (BT=1600),  it 
appears  to  hit  an  asymptote  of  constant  non-zero  error.  This  effect  was  also 
reported  in  [19]  by  applying  a  small  error  approximation  to  the  variance  for 
bandpass  signals.  Specifically,  for  low  BT,  it  was  found  that  even  at  infinite 
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SNR  some  ambiguity  will  occur  at  the  secondary  sidelobes  of  the  signal  auto¬ 
correlation  function.  Thus,  for  low  BT,  the  GCC  is  not  an  optimal  estimator  for 
bandpass  signals.  This  irreducible  error  was  reported  to  be  removable  by  imple¬ 
menting  a  simple  "symmetry  checker”  at  high  SNR  in  [19]. 

In  Figs.  8.13  through  8.15,  we  fix  the  parameters:  f0  =  2000 Hz, 
B„  =  100 Hz  and  Dm  =  0.01,  while  T  is  varied  from  0.08sec.  to  8.0sec.  As  in 
the  previous  case,  the  average  number  of  ambiguities  remains  essentially 
unchanged  at  low  SNR.  The  thresholds  on  the  variance,  and  those  on  the  proba¬ 
bility  approximations,  move  to  lower  SNR  as  T  is  increased.  This  is  physically 
justified  since  the  acquisition  of  more  data  (observation  time)  should  yield  esti¬ 
mates  with  better  statistical  properties.  As  above,  an  irreducible  error  at  high 
SNR  is  indicated  for  low  BT  (T=0.08sec.).  However,  it  is  much  more  severe  here 
where  BT  =  8. 

Finally,  Figs.  8.16  through  8.18  show  the  results  of  changing  the  center  fre¬ 
quency,  f0  =  2000//z  and  f0  =  500 Hz,  while  we  fix  the  parameters: 
B„  =  100 Hz,  Dm  =  0.125,  T  =  8.0see..  The  rate  parameter  differs  markedly  in 
its  steady  state  value  at  low  SNR  between  the  two  cases.  This  is  because  the 
high  frequency  dynamics  of  the  auto-correlation  function  are  the  limiting  factor 
on  the  average  number  of  ambiguities  over  a  fixed  interval.  The  general  move¬ 
ment  of  the  thresholds  is  toward  larger  SNRs  as  we  decrease  the  center  fre¬ 
quency,  which  is  consistent  with  the  Ziv-Zakai  bound’s  behavior  reported  in  [18]. 
Thus,  while  the  local  variance  predicts  more  favorable  performance  at  high  fre¬ 
quencies,  the  Poisson  variance  approximation  brings  out  the  opposite  fact,  as  the 
SNR  falls  below  threshold. 

From  Figs.  8.12  and  8.14  it  is  evident,  from  the  curves  with  parameters  : 
Dm  =  0.125sec.,  T  =  8.0see.,  B„  =  200 Hz,  f0  =  2000 Hz  (Fig.  8.12)  and 
Dm  =  O.Olaec.,  T  =  8.0 sec.,  B0  =  200 Hz,  f0  —  2000 Hz  (Fig.  8.14),  that  the 
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SNR  thresholds  remain  unchanged.  However,  the  point  where  a  priori  informa¬ 
tion  dominates  the  error,  SNR  3,  naturally  differs  in  the  above  two  cases.  Hence, 
as  predicted  in  [18],  SNR  j  and  SNR2  are  independent  of  the  a  priori  interval  of 
time  delay. 

Comparison  of  the  table  of  threshold  values,  in  Fig.  8.9,  with  the  observed 
thresholds,  using  the  Poisson  approximations,  makes  a  few  comments  neccessary. 
In  general,  for  low  BT,  the  two  lower  thresholds,  SNR2  and  SNR3,  of  the  Pois¬ 
son  variance  approximation  occur  very  near  the  thresholds  predicted  by  the  Ziv- 
Zakai  bound.  The  initial  threshold,  SNR  j,  of  the  approximation  occurs  at  much 
higher  SNR  than  the  theoretical  prediction.  Again,  this  latter  behavior  corro¬ 
borates  the  conclusions  of  [19],  where  the  experimental  performance  of  the 
bandpass  GCC  is  unable  to  achieve  the  CRLB  near  threshold.  For  high  BT  the 
opposite  situation  is  the  case.  The  Poisson  approximation  agrees  with  the  Ziv- 
Zakai  theory  up  to  the  initial  SNR  threshold,  SNR  lf  but  is  overly  pessimistic  in 
as  far  as  SNR  2  and  SNR  3  are  concerned.  This  may  indicate  that  while  the  high 
BT  GCC  is  optimal  for  bandpass  spectra,  the  low  BT  GCC  is  not.  On  the  other 
hand,  this  behavior  may  be  due  to  the  inaccuracy  of  the  Poisson  approximation 
below  threshold,  as  was  discussed  in  Section  IV.  These  conjectures  can  only  be 
answered  by  extensive  simulation  studies. 

IX.  Discussion 

In  the  previous  sections  a  general  framework  for  peak  ambiguity  probability 
in  time  delay  estimation  was  developed  in  terms  of  level  crossing  probabilities. 
The  representation  of  level  crossing  probabilities,  using  only  the  intensity  func¬ 
tion  of  the  level  crossings  over  the  a  priori  interval  and  a  correction  term,  led 
naturally  to  a  Poisson  approximation  to  the  probability  of  large  error  and  the 
global  variance  of  the  estimate.  An  analytic  expression  for  the  expected  number 
of  ambiguities  (upcrossings  of  the  ambiguity  process)  was  derived  under  a 
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Gaussian  model  for  the  cross-correlation.  This  allowed  a  magnitude  resolution 
parameter  to  be  associated  with  the  peak  detection  algorithm  which  is  then 
applied  to  the  cross-correlation  trajectory.  It  was  established  that,  under  imper¬ 
fect  magnitude  resolution,  the  average  number  of  ambiguities  is  a  function  of  the 
signal  and  noise  powers  in  addition  to  SNR.  This  is  indicative  of  the  difficulty  in 
detecting  small  differences  of  magnitude  in  quantized  versions  of  weak  or  low 
magnitude  waveforms.  The  result  suggests  that  (noiseless)  amplification  of  the 
correlation  trajectory  can  control  this  type  of  resolution  error. 

For  lowpass  signals,  a  simple  expression  governing  the  average  number  of 
ambiguities  over  a  large  a  priori  region  of  delay  was  derived.  The  resulting 
expression  behaves  in  a  manner  consistent  with  previous  studies  of  the  perfor¬ 
mance  trade-offs  that  exist  between  SNR  and  time-  bandwidth  product.  Not  so 
explicitly  identified  elsewhere  is  the  role  of  the  a  prion'-interval-bandwidth  pro¬ 
duct  in  determining  performance.  Indeed  while  the  time-bandwidth  product 
determines  the  location  of  the  SNR  threshold,  beyond  which  large  errors  predom¬ 
inate  estimator  error,  the  a  pncn-interval-bandwidth  product  controls  the  rapi¬ 
dity  with  which  the  performance  degenerates  beyond  the  threshold. 

The  exact  intensity  function  of  the  peak  ambiguities  was  then  investigated 
for  both  lowpass  and  bandpass  signals.  The  analysis  revealed  that,  while  for  high 
SNR  the  intensity  is  uniformly  small,  for  intermediate  SNR  (i.e.  within  the  ambi¬ 
guity  dominated  region)  the  distribution  of  the  peak  ambiguities  over  time  is  far 
from  uniform,  contrary  to  what  was  assumed  in  [3j.  The  most  severe  variation  of 
the  intensity  over  time  occurs  in  the  neighborhood  of  the  local  maxima  on  the 
sidelobes  of  the  signal  auto-correlation  function.  The  effect  is  most  prominent  for 
the  bandpass  signal,  but  still  significant  for  the  lowpass  signal  over  a  wide  range 
of  SNR.  The  degree  to  which  the  inaccuracy  of  the  uniform  assumption  affects 
the  time  independent  approximation  of  the  average  number  of  ambiguities  over 
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the  a  priori  interval,  for  a  lowpass  signal,  depends  on  the  length  of  the  a  priori 
interval  relative  to  the  correlation  time  of  the  signal,  i.e.  a  prion'-interval- 
bandwidth  product.  In  general,  a  large  a  priori  region  is  essential  for  the  sidelobe 
activity  of  the  cross-correlation  to  be  neglected. 

The  bandpass  intensity  surface  revealed  the  presence  of  four  SNR  regions 
where  the  behavior  of  the  ambiguity  is  distinctly  different.  Over  the  first  region, 
which  extends  from  SNR  j  to  infinity,  the  intensity  is  uniformly  small  over  the 
a  priori  interval.  The  other  three  regions  can  be  called  performance  breakdown 
regions.  In  the  first  breakdown  region,  demarcated  by  two  SNR  thresholds, 
SNR  j  and  SNR  2,  the  error  is  dominated  by  ambiguities  which  occur  within  the 
central  lobe  of  the  envelope  of  the  bandpass  signal  auto-correlation  function. 
This  can  be  interpreted  as  a  second  small  error  region  of  SNR,  that  complements 
the  small  error  region  within  the  central  high  frequency  lobe  (The  linear  region 
for  the  local  variance  analysis  of  Schultheiss  [2]).  As  the  SNR  decreases  beyond 
the  first  breakdown  region,  one  enters  a  region  where  errors  become  significant 
outside  of  the  central  lobe  of  the  envelope.  Finally,  as  the  SNR  decreases 
further,  the  saturation  region  is  attained  where  errors  occur  uniformly  over  the 
entire  a  priori  interval.  The  existence  of  multiple  SNR  thresholds  supports  the 
work  of  Weiss  and  Weinstein  [18]  on  the  behavior  of  the  Ziv-Zakai  lower  bound 
on  estimator  variance. 

While  a  series  expansion  of  the  exact  ambiguity  (upcrossing)  probability  is 
known  to  exist,  it  requires  knowledge  of  all  of  the  higher  moments  of  the  number 
of  ambiguities  (upcrossings).  Here  first  moment  characterizations  of  the  peak 
ambiguity  probability,  the  Poisson  and  corrected  Poisson  models,  in  addition  to 
the  associated  expressions  for  global  variance,  were  investigated  and  compared  to 
Ianniello’s  probability  of  anomaly  for  broadband  lowpass  signals  and  large 
a  pnon-interval-bandwidth  products.  The  Poisson  approximation  over-estimates 
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the  probability  of  ambiguity  for  lowpass  signal  spectra  below  threshold.  However 
it  well  characterizes  the  location  of  the  SNR  threshold.  The  corrected  version 
gives  more  accurate  results  for  these  broadband  lowpass  signals,  but  its  accuracy 
is  unknown  under  narrowband  signal  conditions. 

For  the  low  BT,  bandpass  case  and  high  SNR,  the  Poisson  variance  approxi¬ 
mation  indicates  the  suboptimal  performance  of  the  GCC,  as  was  reported  in 
[19].  Likewise  for  high  BT,  the  approximation  attests  to  the  optimality  of  the 
GCC  for  high  SNR.  The  general  behavior  of  the  approximation,  as  the  various 
parameters  (  observation  time,  center  frequency,  bandwidth  and  a  priori  interval) 
are  varied,  is  consistent  with  the  behavior  of  the  Ziv-Zakai  lower  bound  reported 
in  [18].  In  future  studies  the  applicability  of  the  Poisson  approximations  should 
be  investigated  for  narrowband  signals  by  means  of  comparisons  between  experi¬ 
ment  and  theory. 

The  corrected  Poisson  approximation  can  be  interpreted  as  resulting  from  a 
rough  model  for  the  remainder  term,  q(T),  in  the  representation  of  the  probability 
of  ambiguity  (upcrossing)  (See  Eqs.  (22),  (23)  and  (24)).  A  search  for  tractable 
tight  bounds  on  this  remainder  may  yield  better  first  moment  approximations  to 
the  probability  of  large  errors  than  the  Poisson  examples  considered  here.  Alter¬ 
nately,  inclusion  of  higher  order  moments  of  the  ambiguities,  such  as  variance, 
may  be  a  fruitful  approach  to  improve  upon  these  simple  first  moment  methods. 
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Guide  to  Appendices 
Chapter  5 

Appendices  A,B  and  C  elaborate  on  the  statements  made  in  Section  m  of 
this  chapter.  In  Appendix  A  the  positive  correlation  between  left  and  right  ambi¬ 
guity  intervals  in  the  correlation  domain  for  narrowband  signals  is  clarified  for  a 
simple  choice  of  signal  spectrum.  In  Appendix  B  the  independence  of  the  large 
error  probability  on  the  actual  value  of  the  delay  parameter  is  proven  for  large  a 
priori  interval  of  delay.  Appendix  C  deals  with  the  questions  of  the  shift  invari¬ 
ance  of  the  first  and  second  order  statistics  of  the  GCC  output  relative  to  the 
true  delay,  and  the  uncorrelatedness  of  the  GCC  trajectory  between  the  left  and 
right  ambiguity  intervals  for  lowpass  signal  spectra. 

Appendices  D,E,F  and  G  treat  the  approximation  problems  in  Section  VI. 
Appendix  D  contains  a  justification  of  the  Gaussian  assumption  on  the  GCC 
statistics.  Appendix  E  contams  the  derivation  of  the  rate  function  of  the  boun¬ 
dary  conditioned  upcrossings.  In  Appendix  F,  sufficient  conditions,  in  terms  of 
spectral  moments  of  the  observation  spectra,  are  given  such  that  the  derivative 
continuity,  required  in  the  derivation  of  Appendix  E,  is  satisfied.  In  Appendix  G, 
the  final  form  of  the  uniform  approximation  for  lowpass  signals  is  derived. 

Appendix  I  contains  a  derivation  of  an  identity  which  underlies  the  inhomo¬ 
geneous  Poisson  variance  approximation  of  Section  V. 

APPENDIX  A 

Here  it  is  shown  that  for  xlf  x2  observed  over  an  interval  [0,  T]  as  in  Eq.  (1) 
of  Chapter  2,  D0  =  0  and  flat  bandlimited  signal  spectra  there  is  a  positive 
correlation  between  R g  (r)  and  R  *  (-r)  in  the  neighborhoods  of  the  maxima  of 
the  sidelobes  of  Rlt  (r). 
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From  Chapter  3  Appendix  C  the  covariance  between  R  9  (r)  and  R  9  (-r)  is 

00  r 

°r,  -r  =  r-2r  =  f  /  +  |C12(w)|2  e^Twj  €  ■;'2nj</a^A.l) 


“00 


where  it  has  been  assumed  that  the  observation  time,  T,  is  much  greater  than 
the  decorrelation  time,  Te ,  of  the  signal,  no  segment  averaging  has  been  used, 
and  W[uf)  =  1  in  the  GCC.  We  will  consider  the  lowpass  and  bandpass  cases 
separately. 

For  the  lowpass  case,  assume  the  signal  and  noise  spectra  are  flat  out  to 
±  B/2,  B  <  co,  with  level  S/B  and  N/B  respectively.  Then  Eq.  (A.1)  becomes 
after  some  manipulation 

1 


°T'  ~r  2jt  BT 


where 


8tne\ 


[(5  +  N)2  sine(B  t)  +  S2] 


(x)  =  — a-L 


(A-2) 


(A.3) 


It  is  easily  verified  that  the  auto-correlation  function  Rtl  has  the  form 

(r)  =  ~  sinc(B/2  t)  (A. 4) 

First  note  that  if  the  signal- to-noise  ratio  is  sufficiently  high,  then  from  Eq. 
(A.2)  all  points  r  equidistant  from  zero  are  positively  correlated.  The  condition 
for  this  is 


S/N> 


0.85 


(A.5) 


1  -  \Z2/3tt 

For  arbitrary  signal- to- noise  ratio  note  that  at  the  positive  peaks  of  R„  (r), 

T  =  ,  n  =  1,  2,  •  •  •  [see  Eq.  (A.4)],  we  have  from  Eq.  (A.2) 

&r,  -t  —  S2/2ttB.  Therefore,  if  B  is  small,  a  substantial  positive  correlation  exists 
in  the  regions  of  the  ambiguity  prone  sidelobes  of  Rtt  (r). 
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Now  let  the  signal  and  noises  be  flat  bandpass  centered  about  wt  with  dou¬ 
ble  sided  bandwidth  B  <  oo  and  level  5/(25),  N/(2B)  respectively.  Then  from 
Eq.  (A.1) 

,  -r  =  jpjpp  [cos{2tv,  t)  8inc{BT){S  +  N)2  +  S2]  (A. 6) 

and 

R"{t)  =  jp  cos(W,  t)  8ine(B/2T)  (A. 7) 

From  Eqs.  (A.7)  and  (A.6)  the  identical  result  holds:  for  r  =  (^n  ~  ^)7r  or 

4  w, 

7  ~  m,  n  =  1,  2,  •  •  •  <rr  _r  =  S2/2xBT,  which  is  greater  than 

llJ  * 

zero. 

APPENDIX  B 


Proposition 


Let  Te  be  the  dependence  time  of  R9  and  assume  R?  (r)  is  stationary  out¬ 
side  of  t=  [D0-  Te ,  Dq  +  Te  ].  Then  if  [~Dm  ,  Dm  ]  is  the  a  priori  region  for 
D  0,  and  Dm  >  2  Te ,  the  large  error  probability,  Pt  =  Pt  ( D  0),  is  independent 
of  D0  as  D  q  ranges  over  (- Dm  +2  Te ,  Dm  -2  T()  under  the  Poisson  approxima¬ 
tion  in  Section  IV. 


Proof 


Fix  Dq,  \Dq\  <  Dm  -  Te  and  divide  \-Dm ,  Dm  ]  into  N  = 


intervals  I{ , 


such  that  the  right  endpoint  of  one  of  these,  7t  say,  is  at  D0,  and  I2,  •  •  • 
are  of  length  Te .  Note  by  assumption  3  <  /  <  N- 3.  Hence  except  for  intervals 
h .  ki  R9  is  stationary  over  \-Dm ,  Dm  J.  With  P[Aj )  the  probability  that  a 
large  error  occurs  in  interval  write 

P,(D0)  =  P[l)  Ai)  =  l-P[Z  A) 

♦  —  1  $—1 


(B.1) 
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Now  use  the  product  law  for  probabilities  to  express  (B.l)  as 

p,(d,)  =  i-  n  p[a, | n  J; )  .piA,) 

*■2  i»l 

From  the  independence  of  Ak  ,  A-  |Jt  -  j\  >  1 

p  ( n  )  1  ™  HAk  n  Af^ i)  — 

P,(Da)-y-  •'Mi) 


(B.2) 


(B.3) 


_i  y  j(4n4i) 

^(^JV-l)  *’“3 


^t-^2  n  .a  i)  •  f^a^  n 


For  the  GCC  implementations  of  interest,  the  statistics  of  R3  (r)  undergo  only- 
time  translation  as  D0  varies  (see  Appendix  D).  Hence,  if 
\D0\  <  | Dm  -  2Te  |  ,  [•]  in  Eq.  (B.3)  is  independent  of  D0 


jj1  HAk  H4i) 


Wi)  *“3  P{Ak-i) 


(B.4) 


,  N- 1 

— = —  n 

F"(Am_j)  k—z 

V  k  7*  U  +  1,  l  +  2 


pjAt  n  4m) 
HA  w) 


n2  n 
*-*  *(4m) 


The  first  product  to  the  right  of  Eq.  (B.4)  is  a  constant  independent  of  l  by  the 
stationarity  of  R  3  over  the  relevant  regions.  The  same  holds  for  the  second  pro¬ 
duct  by  the  shift  invariance  of  the  statistics  of  R  3  mentioned  above.  Hence,  for 
any  two  D0  6  (~Dm  +  2Te  ,  Dm  -  2Te ),  D'  and  D"  say,  by  Eq.  (B.3) 

\Pe{D' )- Pt{D"  )\ 

(B.5) 

=  k\f\a i  u  a2)  P[A^  uaw)  -  P[AT  u  at  )  P[aT  ua^ji 

where  Ay  ,  Ay  ;  j  =  1,  N,  denote  events  over  the  two  extreme  intervals  in  the 
partition  construction  for  D  and  D'  '  respectively,  and  K  is  given  by  Eq.  (B.4). 
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Note  if  Ij  and  Ij  are  the  intervals  over  which  A-  and  A-  '  are  respec¬ 
tively  defined  then 

(B.6) 

ha'  u  ii  +  mi,  u  is  ii  =  ii/,'  '  u  '  ii  +  ii/ji.;  u  /; '  ii  =  l 

where  L  a  common  length. 

For  /  an  interval  of  length  \\1\\,  disjoint  from  [D0  -  Te ,  D0  +  Te  ],  the  sta¬ 
tionary  of  Ri  over  /  implies  the  Poisson  large  error  approximation  of  (26)  is 
only  dependent  on  the  length  of  I.  Furthermore,  substitution  of  the  Poisson 
approximation  to  Pe ,  P  *  of  Eq.  (27),  into  Eq.  (17)  gives 

P{N{1)  >  0)  =  £l  -  exp(-\e  ||/]|)  j  F(-t)  +  (1  -  F\-e))  (B.7) 

or 

P{m  =  0)  =  exp(-Xe  ||/||)  F[-e)  (B.8) 

Here  we  have  used  the  notation  F{-€)  =  F\-t,  d°  I),  the  probability  that  R g  (d° ) 
is  less  than  — and  \e  =  \e  (r),  the  conditional  intensity;  respectively  indepen¬ 
dent  of  the  endpoint  d°  I  and  r  by  stationary.  Use  of  Eq.  (B.8)  in  Eq.  (B.5)  for 
P[AX  L }  A2  )  =  P{N{Ii  U  1 2  )  >  0),  and  analogously  for  the  other  three 
quantities,  gives  the  desired  result 

\Pe(D'  )-Pe(D"  )\=0  (B.9) 

when  relation  (B.6)  is  taken  into  account. 

APPENDIX  C 

Here  two  statements  will  be  clarified.  First,  f??(r)  is  approximately 
independent  between  the  left  and  right  large  error  intervals  r  6  4  and  r  E  Ir  , 
given  in  Eq.  (3.7),  for  lowpass  broadband  signals  when  6  in  Eq.  (3.7)  is  set  to 
2; t/B,  B  the  two-sided  bandwidth  of  the  signal.  Second,  we  show  the  shift 
invariance  of  the  first  and  second  order  statistics  of  R  g  relative  to  the  true  delay 
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D0.  Throughout  we  assume  Rg  to  be  well  characterized  by  a  Gaussian  model 
(see  Appendix  E). 

R  g  ( 7 )  has  mean 

1  °° 

E{R '  (7)}  =  —  /  Gl2(u)  W[u)e^du  (C.l) 

—OO 

and  from  Chapter  3  Appendix  C  R  9  ( rj ),  R  *  (q  +  r)  have  covariance 

1  °° 

<t(»7,  7  +  t)  =  —  /  (G nMffafw)  +  Gx %{w)e>'2m'\  W[u)e’“T  (C.2) 

— 00 

where  k  is  proportional  to  T)  the  sensor  observation  time.  Using  the  fact 

Cl2M  =  C„M<-'"£>I  (C.3) 

(C.l)  and  (C.2)  become 

E{R>M}  =  ±  /  G,»  Wlu^-oJju,  (C.4) 

—00 

00  — 

tj  +  r)  =  J  \Gn(<J)G^(u)  +  Gt,{u)e^-D^\  e>WTdu  (C.5) 

—00  J 

Clearly  (C.4)  and  (C.5)  depend  on  7  and  D0  only  through  the  difference  7  +  D0 . 
Since  the  two  first  moments  of  a  Gaussian  process  completely  characterize  its 
statistics  the  shift  invariance  of  the  statistics  of  R  *  to  D0  is  established. 

Let  Dq  =  0  and  assume  s(t),  n^t)  and  n2(t)  are  lowpass  with  flat  spectra  of 
level  S/B  and  N/B  out  to  frequency  ±5/2.  Then  computation  of  the  integral  in 
Eq.  (C.l)- for  W(w)  =  1  in  the  passband  of  s(t ),  W(w)  =  0  in  the  stopband,  gives 

(7(7,  7  +  t)  =  — ^  ((5  +  N)2  aine(B/2r)  +  S2  ainc{ y  (2 1]  +  r))]  (C.6) 

The  length  of  time  which  separates  IL  and  IR  is  4 tt/B  when  8  in  Eq.  (3.7)  is 

chosen  to  be  2 ir/B.  Hence,  it  suffices  to  note  that  ainc(B/2T)  :=»  0  for  |r|  >  — 

B 

and  B  large  to  see  that  Rg  must  be  uncorrelated,  and  hence  independent,  from 
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APPENDIX  D 


Here  we  show  that  for  sufficient  observation  time  T  the  GCC  trajectory 
may  be  described  to  a  good  approximation  by  Gaussian  statistics,  if  it  has  a  finite 
third  absolute  moment  (Eq.  E.ll). 

Assume  that  the  observation  »  =  1,  2  becomes  independent  over  inter¬ 
vals  separated  by  Te  or  more.  We  divide  the  records  of  length  T  into  m 
subrecords  each  of  length  Tm  where  Tm  »  Te  and  Tm  »  Dm  .  Then  form 
the  raw  cross-correlation  estimates  Rk{r),  Jfc=l,  •  •  •  ,  m,  based  only  on  the  kth 
subrecord. 

CO 

/  **(*)  *ii<r+  r)dr  re[-Tm,  Tm]  (D.l) 

-00 

where 

.  /*.(<)  <  t  <  k  tm 

z«  (0  \  o  otherwise  (^-2) 

The  cross-correlation  estimate  is  then  obtained  by  averaging  over  the  raw  esti¬ 
mates. 

R  i2(r)  =  —  I ]  Rk  (r)  r€[-T’m,  Tm]  (D.3) 

171  b-l 

For  Tm  sufficiently  large  R  12(r)  is  represented  as  the  sum  of  m  independent 
identically  distributed  random  quantities  with  the  following  first  and  second 
order  statistics  (Chapter  3  Appendix  C) 

R[Rk  (*))  =  R„  {t  ~  £>)  (D.4) 

(D.5) 

CO 

cov[Rk  in),  Rk  {ti  +  t) j  =  ~-  /  (G|i(w)Gb(«)  +  G&(u)e*u2*\  •  e}'UTdu 

-00 
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The  GCC  trajectory  over  [-Tm,  Tm]  b  formed  by  filtering  R 12  with  the 
time  domain  equivalent  filter,  tv(t),  of  the  GCC  weight  W(u;).  Let  th  •  •  •  ,  f 
be  r  dbtinct  times  in  \-Tm,  Tm\.  Then  write,  R  *  the  vector  of  r  samples  of 

R* 


R  3  =  E  ?  /  (D.6) 

m  Jt=-i  - 

where 

/  =  (-^  12  (T)  *  w(T)lr  —  >  Rizi7)  *  —  tr }  T  (D.7) 

has  mean 

t>_  ’  ={R..(T-D)  ,S„(r-C)  *cj(r)|r_Jr  (D.8) 

and  covariance 


E  =  (K, ,,)) 

i  “ 

<Te,e  +  c=-^-  /  (<31,(u)C^«)+C12j(«)«'“*1|Htw)l8«'"'</u 


(D.9) 


where  <7^  7  +  f  is  finite  on  R2.  Now  by  a  multi-dimensional  version  of  the  Berry- 
Esseen  Theorem  [8],  if  Pm  b  the  probability  law  of  \/m  3  ~  P  3 1  and  G 

b  the  standard  Gaussian  law;  there  exbts  a  constant  C(r)  such  that 

*uP\Pm  ~  G\  <  C{r)  pz  (D.10) 

v  m 

where 


/'3  =  ^{IE"1/2(^isr-P)|3}  (D.ll) 


and  the  sup  b  over  the  class  of  measurable  convex  subsets  of  r-dimensional  space. 
Therefore,  if  pz  <  oo,  the  finite  dimensional  dbtributions  of  R}  (r)  are  approxi¬ 
mately  multivariate  Gaussian  with  covariance  —  V  and  mean  u  3 ,  for  m  suffi- 

m  _ 

ciently  large. 
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APPENDIX  E 


Let  x(t)  be  a  Gaussian  a.s.  continuous  process.  Denote  by  N(tQ,  t )  the 
number  of  upcrossings  of  a  level  -c  by  x(t)  over  an  interval  [f0,  t].  Here  condi¬ 
tions  will  be  given  such  that  the  conditional  rate  function  of  N,  Ec  [N(tQ,  /)], 
exists  and  expressions  for  the  rate  function  and  the  intensity,  Xe  (r),  will  be 
displayed.  The  conditions  to  be  given  will  also  be  sufficient  for  the  validity  of 
Eqs.  (22)  and  (28)  with  X  =  Xe . 

The  central  result  is  the  following  proposition. 


Proposition  E.l 

Let  x(t)  be  an  a.s.  continuous  Gaussian  process  with  mean  /x(r)  and  covari¬ 
ance  <t (r,  v).  Let  r,y  (r,  r)  =  d ,+J  /dr1  dvJ  <r(r,  v)  and  assume  the  derivatives 

/*(*•),  'io(n  r  io(r,  tQ),  r01(f0,  r),  rn(r,r) 
are  continuous  in  r.  Then  if  the  matrix 


A  = 


roo(r>  T)  roi(r>  T )  roo(r,  *o) 

rio(r,r)  rn(r,r)  r10(r,  t0) 

roo(*o,  r)  r01(t0)r)  r oo(t0,  t0) 


(E.1) 


is  positive  definite  the  following  holds: 


The  expected  number  of  upcrossings  of  -e  by  x(t)  on  [f  0,  f)  given  x(t0)  <  -€  is 


(E.2) 


where 


xe  (r)  =  K(t)  j  y  ${ay  +  9)  exp{~i-  {d3y  +  9f}dy 
0  z 


(E.3) 


and 


(E.4) 
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**r)  WTjXjW 


1 


4>i 


r-<  -M*o)  | 

l  %/*<*  <0  i 


exp 


-7 


a  = 


*  =  H  -  /*(*o)  +  “*  [*  i(*0  -  A*(7))  -  t>  2»H7)]]  v7 
£  =  -»/(7)  +  ~r~  (-€  -  /i(r)) 

«3 


(E.5) 

(E.6) 

(E.7) 


where  in  (E.4)  -  (E.7)  the  elements  of  A-1  are  implicitly  defined 

A-‘  = 


A  6 

bT  e 


d2 

dz 


=  A-±  bbT 
c 


=  6 


(E.8) 


(E.9) 


(E.10) 


Although  the  proof  of  the  above  proposition  is  straightforward,  the  details 
are  tedious  and  will  not  be  given  here.  The  essential  element  is  to  show  that  the 

conditional  joint  density  function,  g  r>  *  (y,  z),  of  i(r)  and  j(.r  +  fy  -  M.t)  gjven 

h 

z(t o)  <  -€  satisfies  the  Leadbetter  conditions  given  in  Chapter  4,  Section  1. 

Then  Leadbetter’s  results  in  [12]  imply  that  (E.2)  holds  for  an  intensity,  Xe  (r) 

00 

equal  to  the  infinite  integral  J  zp  r(—€)z)dz,  where  the  conditional  joint  density 

o 

pA~€>2)  —  *  (“"*»  z)’  The  specific  form  of  the  intensity  Xe  (r)  is  then 

obtained  by  manipulation  of 


/  2  2)dz 


(E.ll) 


into  the  calculable  form  of  (E.4). 
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APPENDIX  F 


Here  moment  conditions  on  the  spectra  of  the  signals  and  noises  s(t)  and 
ni(0>  n2(0  be  given  to  ensure  the  continuity  conditions  on  the  covariance 
function  of  R3 ,  stated  in  Proposition  E.l.  In  the  following,  assume  R  *  (r)  has 
mean  /i(r)  covariance  tr(r,  w)  and  let  r,y  (t,v)  be  defined  as  in  Proposition  E.l. 

Lemma  F.l 


Assume  R*{t)  obeys  a  Gaussian  probability  law.  Let  the  following  four 
moment  conditions  hold.  Then  the  derivatives  //(r),  r10(r,  <r),  r01(r,  <r),  rn(r,  r) 
are  continous  in  their  arguments. 


CO 

^  I  u?G„{uj)du  <  co 
00 

f  M3  <  00 

—00 

1  00 

—  /  <  00 
-oo 
00 

~  /  \u\*G  n{u)G n{u)du  <  00 

— OO 

Proof 


(F.l) 

(F.2) 

(F.3) 

(F.4) 


The  existence  of  the  derivatives  of  /*,  r10,  r01  and  ru  is  sufficient  for  con¬ 
tinuity.  From  the  unbiasedness  of  the  cross-  correlation  estimate 


2?r 

and  its  second  derivative 


00 

/  G„{u)W[u)iiu{T-Da)du 
-00 


(F.5| 


=  f  (w)  (F.6) 

-00 

Now  since  W(a;)  is  a  finite  energy  filter,  we  can  take  W[u)  =  1,  in  (F.6)  and 
obtain  the  bound 
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|p(r)l  <  /  w2*?,,  («)rfw 


(F.7) 


From  Chapter  3  Appendix  C 


r«n  (7 


’r)=2^T  /  GnN<?22(w)«J'“<'-<,>+  G,:-(u)eMv+<7-2Do)du  (F.8) 


Note  from  (F.8) 


(F.9) 

oo  r 

n,  W,  v)  =  /  CMi+>'  [(-1/  c„hcem««'-)  +  rf* 

— OO 

Hence 


lr2o(<r>  u)  <  2^-7’  /  a'2[(Jrn(w)^22(a;)  +  (w)]  du  (F.10) 

-OO 

which  is  bounded  by  (F.4)  (recall  G  XIG  ^  =  G>»  +  Gn  (Gni  +  GA  +  GniGra  ) 
clearly  the  right  side  of  (F.10)  also  bounds  Ir^tr,  v)|. 

Finally,  from  (F.9) 

\~fo  rn(r>  T)l  5:  2x7  /  lwl3[<^n(w)^22(w)  +  G«»(w)j  (F.ll) 

or  the  boundedness  of  (F.3)  and  (F.5)  guarantees  (F.ll)  is  bounded. 

APPENDIX  G 


In  this  appendix  an  approximation  to  the  conditioned  intensity  function 
Xe  (r)  given  in  Eq.  (50)  is  derived.  It  is  specifically  assumed  that  the  signal  and 

B 

noises  possess  flat  bandlimited  spectra  with  one  sided  bandwidth  —  and  spec- 

2 

tral  magnitudes  S/B,  N/B  respectively. 

First  we  need  the  quantities  contained  in  the  matrix  A  of  Proposition  E.l. 
In  Chapter  3,  Appendix  C  the  covariance  function,  <rr  of  R  g  (r)  was  derived. 
For  coherent  correlation  processing  the  result  is  expressed  in  terms  of  the  obser- 
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vation  time  T,  the  auto-spectrum  and  cross-spectrum  of  the  observations,  (7,y(u;), 
i,j  =  1,2 

00 

<r".*“?7T  /  Gr„(u)G22(u)«»'“,“-*l+  C122(w)e'"<"+‘>dj  (G.l) 


-00 


The  ambiguity  process  Ai?  ?  (r)  ==  R  g  (r)  -  i?  9  (D0)  has  covariance 

rOo(t’>  s)  =  ffv,  »  +  °Do,  Do  -  a D o,  •  -  ffv.  Do 

with  first  order  mixed  derivatives 


(G.2) 


r“<u’  *>“■!:  *«,  <  -  •§;  •  ruM  =  ”... (g.3) 


dvds 


For  the  fiat  signal  and  noise  spectra  of  interest,  and  for  D0  =  0,  specific 
expressions  for  the  r,y  can  be  derived  straightforwardly: 


and 


ro«(n  «)  -  + 

r'»(r’ u|  “  S(1 (r~  u|)  '  r| 

+  ^7  [’(I  (r+«l)  r> 


,r  _  -(5  +  JV)2  fl 
10,T’  f)  “  4x7  *7  r| 


(G.4) 


(G.5) 


(G.6) 


+ 


4  icT 


3(Br)-g(f  r) 


„(,  4)  =  B  + 


S2 


2ffT  •  12 


2 ttT  •  4 


5  g1  {Bt) 


(G.7) 


With  respect  to  the  expressions  (G.4),  (G.5),  and  (G.7)  the  following  quantities 
have  been  defined 
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 cos(t)  -  sine(r) 

T 

(G.8) 

g'  (x)  =  -sinc(x)  -  g(x)/x 

(G.9) 

h  (!) 

=  1  +  sine 

IfH 

-  sinc(-j  t)  -  s,ne(| 

v) 

(G.10) 

h  M 

r,  t; 

=  1  +  sincj 

f'H 

|  "  sinc(-J  r)  ~  sinc{^ 

v) 

(G.  11) 

The  mean  of  A R  3  (r),  p(r),  and  its  derivative,  17(7),  have  the  expressions 

(G.12) 


M  =  ±  Km 


and 


,  ,  S  B  ,  B  v 

,(r)  =  2?  7  *7  r> 

where  the  additional  quantity  has  been  defined 


(G.13) 


=  1  -  sinc(—  r) 
2 


The  matrix  A  of  interest  is 


A  = 


roo(r>  T)  r01(r,  r)  r00(r,  ~Dm  ) 

rio(A  t)  rn(r,  r)  r10(r,-Dm) 

r00 (~^m  >  T )  r0l(~An  t  T )  r  00 i~^m  »  ~^m  ) 


(G.14) 


It  is  straightforward,  but  tedious,  to  calculate  the  entries  in  A-1,  where  A  is  as  in 
Proposition  E.l,  Eq.  (E.l).  Implicitly  define  the  matrix  A  and  its  entries  a{ ,  the 
vector  b  and  the  6,- ,  and  the  scalar  c  as  follows 


A'1  = 


A 

bT 


A  = 


ai 

«2 


b  —  [6 1,  b2]T 


(G.15) 

(G.  16) 
(G.17) 


The  determinant  can  be  calculated 


|A|  =  jdw  i  -s  (S  +  **  A  <G-18> 

where 

A  =  3  +  2|712|2  +  t(Bt)  (G.19) 

|712|  is  the  magnitude  coherency  and  r[Br)  =  o((Br)-2)  is  a  quantity  which  is 

much  smaller  than  1  if  B\i\,B\Dm  -rj  >  20;r. 

For  a  given  Dm  ,  r,  define  the  quantities  glt  g2,  g  3  and  g  4 

=  -  J(|  r)  ,  »,=  »(!  (r +£>„))  -  j(|  r) 

(G.20) 

</3  =  -?(y  r)  ,  ?4  =  j(5t)-j(y  r)  ,  g‘  =  g(B  r) 

With  the  above  definitions,  the  entries  in  A-1  are 

(G.21) 

“'“W+NfA  {'1  +  3^IVI  +  hap *.©..-0, ]  -  %i  +  hop*/} 


(G.22) 


-6a-  T 


(S+Nf  A 


J[?3+|712|2?4](*-(d!,,-Om  +l7l2pA  -%  ,-Dm  H?l+|7l2|2^2|[*r(ii)m  +\ll2fhr %m 


(G.23) 


2  AitT 


(S+Nf  BA 


{^V  +  |712|2  A  <2>]  [*48,. -D.  +  l712|2  A-t.-oJ-  [A  rf2o.  +  K2I2  A  r  ,2-Om  ]2J 


(G.24) 

-  {%3  +  l7l2|2ff<1  [ff  1  +  l7l2|2ff2] ' (1  +  3|7l2,v ]  [h'll>”  + 1712,2 ]} 

(G.25) 

{6^^-+^»l**^l  ^i+l7i2l2ff2H[S3  +hnfu\  [Ara„  +|712|2  A?ftj} 
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(G.26) 

c '  UTWK  {'* ”  +  hl2|! *®1  [1  +  3|l'*lV 1  - 3|5j  + 

The  terms  in  A-1,  (G.21)-(G.26),  are  general  expressions,  valid  for  all  r  such  that 
\Bt\  >  and  \B[t  -  Dm  ]|  >  2jt.  However,  we  are  primarily  interested  in 

approximations  to  Xe  when  r  is  such  that  o((Bt)~2)  and  0{(B\Dm  -r])~2)  terms 

can  be  neglected.  For  simplicity  o((£r)"2)  will  be  used  to  denote  both  of  the 

above  O  notations.  With  this  in  mind,  up  to  o((5r)-2)),  (G.21)-(G.26)  are 
equivalent  to  the  compact  identities 


2kBT_  l  +  |7i212 

(s  +  N)2  3  +  2|7l2|2 


a  2 


rr_ 

(. S  +  N )2 


24  xT  1 
{S  +  N)2  B 


(G.27) 


-2  xBT  1  +  hi2|2 

(S  +  N)2  3  +  2|7l2|2 


-vT 

{S  +  N)2 


(G.28) 


e  _  2  *BT_  2  +  |7l2|2 

{S  +  N)2  3  +  2|7l2|2 

For  the  above,  the  following  approximations  were  used 

h  r}-Dm  =  hr^-Dm  =  1  +  0(l/5r)  t  jk  -Dm 


(G.29) 


*,,<!>  -  2,  V?  —  1,  , ,  —  U  =  g,  =  u  =  o( -L ) 

where  the  above  quantities  are  defined  in  (G.10),  (G.ll)  and  (G.20).  From 
(G.27)-(G.29),  we  can  compute  the  d,-  making  up  the  matrix 
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in  Proposition  E.l.  The  results  are 


dx  = 


2  ttBT 


(S  +  Nf  2  +  hys 


j  ^2  — 


(G.30) 


{S+  N)2 


0(i/Bt)  ,  iz=a. 


We  will  also  need  the  quantity 


a  = 


y/c  y/d] 

which  is  a  function  of  Bt  but  not  of  SNR. 


=  0 


Bt 


(G.31) 


Now  from  the  equations  for  ji(r)  and  r/(r),  (G.12)  and  (G.13),  and  the  rela¬ 
tions  (G.27)-(G.29),  we  can  derive  expressions  for  9  and  f  in  (E.6)  and 

(E.7)  of  Proposition  E.l 


9  = 


b2  b 


yfc 


d2 

-n(r)  -  —  h{t) 

“3 


(G.32) 

(G.33) 


where  x9  =  -e  is  set  to  0  in  Proposition  E.l.  The  specific  results  for  the  present 
case  are,  up  to  0(l/5r) 


9  = 


ii  /  BT 

b,2l  \/  •=■ 


|(2  +  |7|2|2)  (3  +  2|7l2|2)|'/2 


?  =  hi2\ 


BT 

2x 


0(1/Rr) 


(G.34) 


(G.35) 


Note  the  similar  dependencies  of  9  and  f  on  the  quantity  |712| v/ BT /2ff. 
Recall  the  form  of  K{t)  in  Eq.  (E.4)  with  a:0  =  t  =  0 


K(r)  = 


‘I'K'fc  |A|*^2 


4> 


M-Dm  ) 


exp 


/  do- 


(G.36) 


\/a-Dm ,  -Dm 
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Here  we  will  need  K(r)/d3.  From  the  above  it  is  straightforward  to  calculate,  up 
to  0(1/57)  terms 


m  =  _  , 

'/U  V2  +  lid2 


(G.37) 


1 

\/2  +  hi? 


We  will  investigate  the  form  of  the  conditional  intensity,  Xe  (r),  under  condi¬ 
tions  or  either  large  or  small  signal-tonoise  ratio,  |-y12|  VET,  or,  alternately,  large 
values  of  B\t\  and  B[r-Dm\.  We  first  consider  the  latter  case,  which 
corresponds  to  an  investigation  of  Xe  (r)  outside  of  the  high  sidelobe  region  of  the 
signal-auto-correlation  function. 


Make  a  change  of  variable,  v  —  y,  in  the  integral  associated  with  the 
intensity  function,  Eq.  (E.3) 


(r)  =  K{*)  /  y${ay  +  0)  exp (~d3  ( y  +  £)2) 
o 


(G.38) 


This  yields  the  equivalent  expression 

Xe  (r)  =  V2ttK(t)/  d3  H{a)  (G.39) 

where 


H{a)  =  /  y${ay  +  0)  <f>(y  +  $)dy  (G.40) 

0 

Here  a  and  f  are  as  defined  in  Eqs.  (G.31)  and  (G.33),  and  <f>  is  the  standard 
Gaussian  density  function.  The  integral  H(a)  will  be  expanded  in  an  asymptotic 

series  about  the  parameter  a,  a(r)  =  oj  -J-  | ,  defined  in  Eq.  (G.31)  to  motivate 

the  uniform  approximation 


fl|a)  =  4>(0)  -j(f) 


(G.41) 
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The  next  step  is  to  show  sufficient  regularity  of  the  integral  H[a)  in  order  to 
exchange  derivative  and  integral  operators.  The  first  derivative  of  the  integrand 
of  H(a),  (G.40),  is  uniformly  continuous  in  a  and  has  a  bounded  integral 

—  y<t>(ay  +  9)  <f>{y  +  f)  =  y2<t>{ay  +  9)  <f>{y  +  f)  (G.42) 

and 


/  V 2<t>{«y  +  9)  <f>{y  +  $)dy  < 


I  y2<f>(y  +  $)dy 


=  -f  0(f)  +  (s2  +  1)  (1  -  $(f)]  =  P  l(f) 


p !  is  finite  since  for  the  Gaussian  density  <j>  [10] 


lim  f*  ?%)  =  0 

If)  -  00 

and 


lim  f*  [1  -  $(?)]  =  0 

|f|  —  00 

Likewise,  the  second  derivative  of  the  integrand  of  H(a) 

d2 

■—  y<i>{oty  +  9)  (f>{y  +  f) 

OCT 

=  -y2{ay  +  9)  <j){ay  +  9)  <j>{y  +  <;) 

and 


(G.43) 


(G.44) 


(G.45) 


OO 

/  y2{ay  +  9 )  <f)(ay  +  9)  <f>(y  +  f)  </y 
o 

00 


<  /  (H  yz  +  M  y2)  4>{y  +  f)<fy 

0 

=  3!  |a|  <£(?)  D ^  +  |0|  Pl(f)  =  p2(f) 


(G.46) 


where  D_v(z)  is  a  parabolic  cylinder  function  of  order  v  [9]  and  is  as  in 

(G.43).  Note  from  [9] 


lim  <p{$)  =  0  (G.47) 

f  —  00 


and  since  9,  f  ~  |712|  VBT/(4~)  (see  Eqs.  (G.34)  and  (G.35)) 
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...  f™  \0\  P(f)  =  0 
1*1.  Id  —  oo 

The  boundedness  and  continuity  properties  of  the  integral  and  the  integrand 

respectively  imply  sufficient  smoothness  so  that  the  Taylor  remainder  theorem 
can  be  invoked 

H{a)  =  H{0)  +  otH'  (0)  +  a2/2  H’ '  (a)  (G.48) 

where  ex  is  in  the  neighborhood  of  zero,  and  the  differentiation  and  integration  in 
H’  and  H  can  be  interchanged.  Performing  the  integrations  involved  in  H{0) 
and  H!  (0)  we  obtain 

H[a)  =  $(0)  (<%)  -  f(l  -  <%)])  (G.49) 

+  a<t>{9)  Pi(f)  +  0(a2)  p2(f) 

Note  that  since  f  and  a  are  0(l/(5|r|)),  in  the  sense  that  both  l/(B\i\)  and 
ll(B\Dm—T\)  dominate  f  and  or,  Eq.  (G.49)  suggests  the  approximation  given  in 
Eq.  (G.41).  Investigation  of  the  relative  magnitudes  of  the  various  terms  in  Eq. 
(G.49)  indicates  that  if  both  B\t\  and  B\t—  Dm  |  exceed  20 ir  then  the  approxima¬ 
tion  (G.41)  is  within  about  5%  of  its  actual  value.  Hence,  the  approximation 
(G.41)  will  be  valid  over  the  majority  of  the  of  the  a  priori  interval  for  large 
BDm  for  all  SNR. 

We  next  turn  our  attention  to  the  case  where  the  0(R|r|)  term  a(r)  is  large, 
e.g.  in  the  sidelobe  region  of  the  signal  auto-correlation  function.  It  can  be  shown 
that  a  =  a(r),  Eq.  (G.31),  is  bounded  for  all  r  such  that  R|t|,  B\t-  Dm  |  >  2jt. 

(Just  use  the  relation  |ft|  <  in  (G.25),  (G.26)  and  (G.30)).  Therefore,  using 

(G.44),  (G.45)  and  (G.47)  in  the  expressions  for  px  and  p2,  (G.43)  and  (G.46), 
p  j(f)  and  p  2(f)  go  to  zero  as  f  and  9  become  large,  which  occurs  when 
hrul  ^bt  *  co-  However,  if  I712I  '/BT  is  not  large,  then  the  terms  involving  cx, 
in  Eq.  (G.49),  may  be  significant.  Nonetheless,  it  is  possible  to  show,  by  using 
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integration  by  parts  of  H(a)  for  a^O,  that 

H{a)  =  <f>($)  -  ?( 1  -  <%)  $(0)) 


(G.50) 


_J_  AjlLsL 

1  +  a2  I  \/l  +  a2 


where 


_£+_a0_ 

Vl  +  a2 

+  — 
a 


1  -  $ 


i?(a) 


£  +  O0 

Vi  +  a2 


4 

l  Vl  +  a2 


w«)i  <  -£•  U- )  -  - 

ala  a 


(G.51) 


Now  as  |712|  VBT,  goes  to  zero  for  finite  a,  R(a)  — ►  0,  and  from  (G.50) 


ma)  -  W)  <H;)  +  ±-  -L-  (G.52) 

2x  1  4- 

The  right  hand  side  of  (G.52)  can  be  quite  close  to  (G.41)  in  the  high  sidelobe 
regions  where  a  may  be  large. 

Combining  (G.49)  for  small  0(5|rj),  with  (G.52)  for  large  0(5|t()  ,  it  follows 
that  for  the  following  approximation  to  the  intensity 

=  *(*)#{)  (G.53) 

“3 


the  approximation  error  is  small  for  the  following  cases  B\t\  and  B\Dm  -rj 
greater  than  20r;  |712|  v/jBT  »  1;  or  both  |712|  sfBT  «  1  and  a2  large.  In 
the  sequel  we  concentrate  on  the  first  of  the  three  cases  mentioned  above. 

The  final  form  of  the  time  independent  intensity  approximation  used  in  Sec¬ 
tion  VI  is  obtained  by  substituting  the  approximate  expressions  for  0  and 
(G.34)  and  (G.35),  into  (G.53).  Using  f  ~  0,  we  obtain 


_So_  i  *(7  (3  +  2|7I212)-*/2) 

^  nATTt I?  $(7  ^/B^T] 


(G.54) 
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•  v/2 


where  we  have  defined  the  normalized  signal  bandwidth  B 0  in  Hz 


and 


B0  = 


B_ 

2z 


7 


2  +  |7,2|2 


(G.55) 


For  the  example  considered  in  Section  VI,  the  function  a(r)  is  plotted  in  Fig. 
6.1.  From  Fig.  6.1  two  things  are  clear,  a  is  of  small  magnitude  over  the  major¬ 
ity  of  the  a  priori  region  of  delay  \-Dm  ,  2 tt/B]  ([  -8,  0  j  in  the  figure).  Also,  a 

> 

has  a  small  average  value  over  the  regions  where  a  itself  is  large.  Therefore,  the 
integral  over  the  a  priori  region  is  approximately  independent  of  linear  terms  in 
a.  Consequently,  the  approximation,  (G.54),  can  be  said  to  be  accurate  to  0( a2). 

APPENDIX  H 


Here  we  derive  the  identity 


B(oj{  E  [f,  t  +  A],  some  »  =  1,  2,  •  •  •  ,  k) 

1  *-t 

J  \(s)ds 

I 


=  \{t)  •  A 


(H.1) 


(*- 


“Tjj -  exp{-/  X(s)ds} 


where  u>{  are  discrete  times  within  the  interval  /=  [f0>  tj)  at  which  a  Poisson 
count  process  on  /,  N  ‘  (1),  generates  points.  Here  N  ‘  is  assumed  to  have  the 
time  continuous  intensity  X,  and  A  is  an  infinitesimal  quantity. 

The  left  hand  side  of  (H.1)  is  equivalent  to 


(H.2) 


m= 


(  r7V~l  m+J-1  k  \ 

)  p\  n  K  e  1/ 0>  <]}.  .n  K  e  [t,  t  +  a]},  n  {«,•  e  [t  +  a,  m} 

*1  '  *™1  »*m  j  =m+/  '  ) 
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where  (H.l)  has  merely  been  expressed  as  the  union  of  the  disjoint  events:  m-1 
points  preceed  time  f;  /  points  inhabit  [#,  t  +  A],  k  -  (m+/)+l  points  follow  time 
t  +  A. 

For  sufficiently  small  A,  the  orderliness  property  of  the  Poisson  process  [15] 
guarantees  that  all  but  the  following  terms  in  (H.2)  are  negligible 


k  ( m-1  v 

E  n  n  {w,-  €  [*o>  *]}>  Wm  €[t,  t  +  a]},  n  {wm  e  [t  +  a,  lym 

m—  1  1,38,1  t—m+1  ) 

From  the  independent  increment  property  of  N  * ,  (H.3)  is  identically 


(H.3) 


/  \(s)ds 

to 


m-1 


k 

«2i  (m-1)! 


t  +  A 

/  X(s)rfa 


J  X(s)ds 

t  +  A 


k-r. 


(k~m)\ 


exp  {- J  X(a)ds}  (H.4) 


Or  use  the  continuity  of  X(s)  to  obtain  from  (H.4) 


MO  •  A  g 


j  (m-l)l(^-m)! 


1  m-1 


/  \(s)da 


J  \(s)ds 

t 


k~m 


(H.5) 


Finally  recognize  the  following  to  obtain  (H.l):  the  sum  in  (H.5)  is  equivalent  to 

£-l-m 


*-l 

E 


ltDL 


(*-!)!  ZL 0  rn!(Ar-l-m)! 

1 


(*-!)! 


f  \(s)di 


/  \(s)ds 


f  Ms)ds 


k-l 


(H.6) 


where  the  binomial  theorem  has  been  invoked. 
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OCOt)  for  Lowpass  Signal  Spectrum 
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Conditioned  and  Unconditioned  Rate  Functions 
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Intensity  Surface  for  Lowpass  Signal  Spectrum 
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Difference  Between  True  end  Uniform  Approximation  to  Rate 
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Various  Large  Error  Probability  Approximations 
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Various  Large  Error  Probability  Approximations 
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Variance  Approximations  vs.  Experimental  Results 
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SNR CdB)  Thresholds  Predicted  by  Ziv-Zakai  Lower  Bound 
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Rate  Function  for  High  and  Low  Bandwidth 
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Variance  Approximations  for  High  and  Low  Bandwidth 
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Error  Probability  for  High  and  Low  T 
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Chapter  6 
Additional  Topics 

1.  Introduction 

In  this  chapter  two  novel  time  delay  estimators  will  be  presented.  Because 
of  time  and  space  limitations,  a  comprehensive  analysis  is  not  the  objective  here; 
rather  it  is  to  explore  in  a  preliminary  manner  some  interesting  additional  alter¬ 
natives  to  the  classical  techniques.  Hence,  the  presentation  and  development  will 
be  informal. 

In  Sections  II,  HI  and  IV,  we  turn  to  time  delay  estimation  for  highly  nar¬ 
rowband  signals,  that  is  when  the  cross-correlation  function  is  oscillatory  and 
ambiguity  prone.  A  reinterpretation  of  the  work  of  Chow  and  Schultheiss  [4]  on 
the  Barankin  lower  bound  reveals  two  facts:  1).  our  definition  of  SNR  in  Chapter 

2,  SNR !,  plays  a  major  role  in  the  determination  of  the  lower  bound  on  achiev¬ 
able  estimation  error  ,  and  2).  phase  information  contained  in  the  observations 
becomes  essentially  useless  at  very  low  SNR.  The  above  observations  are  used  to 
motivate  a  hybrid  estimator  structure,  a  GCC  which  acts  on  both  the  observa¬ 
tions  and  their  envelopes.  We  then  seek  to  optimize  the  structure  by  penalizing 
poor  local  (small  error)  performance  while  maintaining  acceptable  (low)  sidelobe 
activity  (large  error).  The  form  of  the  optimal  hybrid  processor  is  then  displayed. 
This  involves  locally  optimal  GCC  processing,  combined  with  equalization  via  a 
tapped  delay  ine. 

In  Section  V,  a  method  is  presented  which  transforms  the  inherently  non¬ 
linear  problem  of  estimating  time  delay  into  an  (approximately)  linear  estimation 
problem.  This  is  accomplished  by  operating  on  the  cross-correlation  trajectory 
with  a  linear,  invertible,  transformation,  which  demodulates  the  time  delay 
directly  onto  the  correlation  domain.  Optimal  and  sub-optimal  procedures  are 
then  advanced  as  possible  estimation  schemes. 
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II.  Background 

The  observations,  over  [0,7],  containing  the  time  delay  parameter,  D,  are  as 
in  chapter  3,  Eq.  (1).  That  is,  it  is  assumed  that  two  stationary  Gaussian 
waveforms  are  available,  each  containing  a  common,  but  delayed  in  one  case, 
Gaussian  signal,  s(f),  here  of  one-sided  bandwidth  B ,  buried  in  broadband  mutu¬ 
ally  uncorrelated  Gaussian  noise  processes  ,  and  n2(f).  For  sufficiently 

large  observation  time-bandwidth  product  (BT)  the  Cramer-Rao  Lower  Bound 
(CRLB)  on  the  variance  of  any  estimate  of  D,  D  can  be  calculated  [l],  [2].  Specif¬ 
ically 


JcRLB  {D)  — 


_1_ 

2t 


2  bi2(u>)l 

W~ - 

1  -  buHl2 


(i) 


where  JCrlb  iD)  is  the  inverse  of  the  CRLB,  or  the  Fisher  information,  and  as 
usual,  |712(«;)|2  is  the  magnitude  squared  coherency  defined  in  Chapter  2,  Eq. 
(10).  Since  |712(«>)|2  measures  the  importance  of  signal  energy  relative  to  noise 
energy  at  a  given  frequency  w,  JCRLB  ( D )  can  be  interpreted  as  a  measure  of  the 
frequency  spread  of  usable  signal  energy  for  lowpass  signals  (See  Fig.  2.2a). 

Recall,  at  high  signal-to-noise  ratio  (SNR)  the  performance  of  the  GCC  is 
well  characterized  by  the  local  approximation  to  estimator  variance,  given  by 
Chapter  3  Eq.  (23).  As  discussed  in  Chapters  3  and  5  the  local  variance  assumes 
its  minimum  value  when  the  Hannan  Thomson  (H.T.)  weight  is  used  for  W[w)  in 
the  GCC.  (For  definitions  of  the  GCC  trajectory  with  weight  VV(u;)  and  the  H.T. 
see  Chapter  2,  Eqs.  (6)  and  (13)).  Furthermore  this  minimum  is  identically  the 
CRLB,  the  inverse  of  JCrlb  (£*)•  As  was  discussed  in  Chapter  2,  the  GCC  perfor¬ 
mance  measure  SNR  t,  ch.  2,  Eq.  (12),  is  maximized  over  all  W^w)  by  the  H.T.. 
Consequently,  it  is  clear  that  the  H.  T.  has  a  strong  claim  to  optimality  when  BT 
and  the  signal-to-noise  ratio  are  large. 
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However,  SNR  j  is  only  reliable  as  a  local  (small  error)  performance  measure 
since  it  applies  equal  penalty  to  all  errors,  large  and  small  (Recall  discussion  in 
Section  II  of  Chapter  2  ).  In  addition  the  CRLB  on  the  error  variance  is 
unachievable  below  a  certain  SNR  threshold  determined  by  the  center  frequency 
to  bandwidth  ratio  ( wJB )  and  BT  (for  bandpass  signals)  [3],  [4j.  Therefore  the 
H.T.  can  only  be  considered  optimal  in  a  restricted  sense,  which  we  will  refer  to 
as  local  optimality.  In  [3]  a  tighter  lower  bound  on  the  error  variance  than  the 
CRLB  was  derived,  based  on  the  Ziv-Zakai  lower  bound  (ZZLB).  The  ZZLB 
based  bound  can  be  considered  a  composite  bound  made  up  of  the  following  as 
the  SNR  varies  from  high  to  low  values:  the  CRLB,  a  version  of  the  ZZLB,  the 
Barankin  lower  bound  (BLB),  and  finally  the  lower  bound  given  by  uniformly  dis¬ 
tributed  estimates  throughout  the  a  priori  region  of  time  delay.  A  typical  exam¬ 
ple  of  the  behavior  of  the  composite  bound  is  roughly  reproduced  from  [3]  in  Fig. 
2.1  for  clarity. 

Using  intuition  gained  from  an  investigation  of  the  specific  form  of  the 
Barankin  bound  derived  in  [4],  a  more  global  measure  of  performance  is  proposed, 
i.e.,  a  measure  which  is  reliable  for  a  greater  range  of  SNR.  This  measure  can 
then  be  optimized  to  yield  an  interesting  processor  structure. 

HI.  Interpretation  of  the  Barankin  Bound 

In  its  original  form,  as  proposed  by  Barankin  [5],  the  Barankin  lower  bound 
is  a  greatest  lower  bound  on  an  unbiased  estimator’s  error  variance.  In  other 
words,  there  always  exists  an  estimator  which  achieves  the  Barankin  bound. 
However  the  form  of  the  bound  and  the  construction  of  the  optimal  estimator  are 
difficult.  The  specific  form  of  the  Barankin  lower  bound  used  in  the  context  of 
time  delay  estimation  [4],  the  BLB,  is  a  considerably  weaker  version  of  the  origi¬ 
nal  Barankin  bound  and  is  not  acheivable  in  general.  Nevertheless  it  is  tighter 
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than  the  CRLB  for  sufficiently  low  SNR,  by  orders  of  magnitude  in  some  cases, 
and  as  such  gives  more  insight  into  the  limiting  factors  affecting  performance. 

In  [4]  a  general  expression  for  the  inverse  of  the  Barankin  bound,  which  we 
will  refer  to  as  JB{D),  in  the  context  of  time  delay  estimation  is  given  for  nar¬ 
rowband  bandpass  signal  spectra.  The  result  in  [4]  is  derived  under  the  assump¬ 
tions  of  multiple  (M)  sensors,  white  noises,  large  BT,  and  large  center  frequency- 
to-bandwidth  ratio  ( w0/B ).  This  expression,  [4,  Eq.  (20)],  will  be  adapted  to  the 
present  case  of  interest,  i.e.  A/=2  and  low  SNR.  In  Eq.  (20)  of  the  reference,  iden¬ 
tify  the  ratio  of  signal  and  noise  spectra  as  the  magnitude  coherency  squared, 
|7i2WI2-  Use  the  following  low  SNR  approximation  (G{w)  a  SNR): 

exP{-J"ln(l  “  G(w))dw}  -  1  =  J G{w)dw,  to  obtain  an  expression  equivalent  to 
Eq.  (20)  of  [4]: 


00 

/  (H  - 

-oo 


bi2NI2 

1  -  |7i2M|2 


dw 


(2) 


In  (2)  we  have  transformed  the  summation  in  Eq.  (20)  of  [4],  indexed  over  a  dense 
set  within  a  segment  of  the  positive  real  line,  to  an  integral  over  the  entire  real 
axis,  by  using  identical  large  BT  assumptions  as  were  used  in  [4]  to  obtain  Eq. 
(23)  of  [4], 

The  important  difference  between  JB  (D)  and  Jcrlb(^)^  (1)  and  (2),  is  that 
while  Jqrlb  {D)  measures  the  zero  centered  moment  of  the  spectral  quantity, 
|7i2MI2/(1  -  |7i2(«’)|2),  Jb(D)  measures  the  second  moment  centered  about  the 
center  frequency  w0 .  Thus  Jr{D)  is  a  more  accurate  indicator  of  the  actual 
spread  of  signal  energy  over  frequency  than  JCrlb  (D)  (See  Fig.  2.1b).  It  is  useful 
to  investigate  the  form  of  JB  ( D )  for  highly  narrowband  signal  spectra.  Multiply 
out  the  square  term  in  (2)  and  distribute  the  integral  over  the  resultant  three 
terms.  Note  that  if  |712(«;)|2  is  highly  concentrated  about  the  center  frequency 
w0  then  \w\lw0  is  approximately  unity  over  the  w-region  where  |712(u>)|2  is 


-  181  - 


significantly  non-zero.  Hence  we  have  as  an  approximation 


CO 


/  W‘ 


1712MI2 

1  -  fruHl* 


00 

dw  -  w2  f 

0  •->*•  J 


2jr  1  -  |7l2M|2 


dw 


(3) 


One  can  now  identify  the  difference  in  (3)  in  terms  of  the  minimum  local  vari¬ 
ance,  Eq.  (23)  of  Chapter  3,  rar/  =  min{vari  (£>)},  i.e.  the  CRLB,  and  the  max¬ 
imum  of  SNR  j,  Eq.  (12)  of  Chapter  2,  SNR  j  =  max{57Vf?  j},  both  achieved  for 
the  H.T.  GCC 


JB(f>)  =  — 7  -w2SNR{  (4) 

var£ 

This  interesting  result  implies  that,  while  the  local  measures,  varL  and  SNR  x  are 
not  individually  sufficient  to  characterize  the  large  error  performance  of  the 
optimal  estimator,  a  linear  combination  of  these  local  criteria  does  parameterize 
the  large  error  performance  for  sufficiently  narrowband  bandpass  signal  spectra. 
In  the  following  section  this  fact  is  used  to  motivate  a  composite  local  perfor¬ 
mance  criterion,  p  =  varL  +  1  /w2  SNR  f1,  where  the  normalization  of  SNR  x  is 
to  make  the  two  components  of  p  of  similar  order  of  magnitude. 

Observe  that  the  BLB  corresponds  to  the  CRLB  in  the  case  where  only  the 
envelopes  of  the  observed  waveforms,  X!  and  x2  are  available.  Hence  the  high 
frequency  components  in  the  observations  play  no  part  in  the  BLB.  In  so  far  as 
the  BLB  is  indicative  of  the  optimal  estimator’s  low  SNR  performance,  this 
implies  that  the  phase  information  in  the  bandpass  signal,  s(t),  is  useless  at  very 
low  SNR.  It  was  suggested  in  [4]  that  at  low  SNR  a  near  optimal  time  delay  esti¬ 
mate  can  be  obtained  by  passing  the  envelopes  of  the  observed  waveforms 
through  a  cross-correlator  instead  of  the  observables  themselves.  A  more  general 
implementation,  using  a  GCC,  will  be  referred  to  as  the  GCC  envelope  processor. 
Cross- correlation  of  the  envelopes  was  motivated  in  [4]  by  consideration  of  the 
asymptotic  form  of  JB  ( D ),  Eq.  (20)  of  the  reference,  for  the  special  case  of  flat 
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bandpass  signal  spectra.  It  is  easily  seen  that  any  one  of  the  GCC  weights, 
W[w),  discussed  in  Chapter  2  is  suitable  for  the  GCC  envelope  processor  in  this 
particular  case.  In  the  general  case,  the  local  variance  of  the  GCC  envelope  pro¬ 
cessor,  varc  ( D ),  is  straightforward  to  derive  from  the  local  variance  expression  of 
Schultheiss  [6]  (See  Ch.  3  Eq.  (23)) 


I  (\w\- wo)2gu(w)G22(w)(1 


oo 

2 

4-  /  (M  -  W9  )2\G  I2(u;)|  W{w)dw 
2T  -00 

(5) 


where,  as  in  Chapter  3,  the  auto-spectra  and  cross-spectra  of  the  observed 
waveforms  have  been  denoted  G  n,  C22  and  G  l2  respectively.  The  local  variance 
expression  of  Eq.  (5)  is  minimized  by  ^ht(\w\-w«  )>  a  frequency  shifted  version 
of  the  optimal  H.T.  weight  given  in  Chapter  2  Eq.  (13),  and  repeated  here 

1  |7i2HI2 


wht{w)  = 


\Gl2(w)\  1  -  |7l2(w)|2 


(6) 


Furthermore  the  minimum  of  vart  ( D ),  taken  at  Wfw)  =  WHT(\w\-w0 ),  is  identi¬ 
cally  the  BLB,  the  inverse  of  Jq{D )  in  (2).  Hence  the  H.T.  envelope  processor  is 
locally  optimal  for  narrowband  bandpass  signals  at  low  SNR. 


The  expression,  (2),  for  the  inverse  of  the  BLB  is  only  valid  for  very  low 
SNR.  Near  threshold,  where  the  BLB  is  exceeded  first  by  the  Ziv-Zakai  and 
finally  by  the  CRLB,  exclusive  processing  of  only  the  envelopes  of  the  observa¬ 
tions  entails  a  loss  in  important  phase  information.  In  the  next  section  a  more 
sophisticated  processor  is  proposed,  which  is  based  on  the  optimization  of  a 
hybrid  GCC-GCC-envelope-processor  structure.  The  optimization  is  performed 
with  respect  to  the  local  variance  of  this  hybrid.  However,  since  the  variance  is 
only  a  local  approximation,  we  will  add  additional  design  restrictions  on  the 
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optimal  processsor  by  adjoining  constraints  which  control  the  ambiguity  prone 
sidelobes  of  the  GCC. 

IV.  The  Hybrid  Processor 

The  approach  taken  to  optimize  a  combined  envelope  and  nominal  GCC 
processor  is  to  penalize  the  candidate  processor  for  poor  local  performance  (small 
errors)  while  constraining  it  to  supress  its  ambiguity  prone  sidelobes  (large 
errors).  The  specific  processor  structure  which  we  will  investigate  is  displayed  in 
Fig.  4.1,  the  GCC— GCC-envelope  processor.  Two  envelope  waveforms  are 
obtained  from  the  narrowband  bandpass  observations,  xx  and  x2.  A  common 
reference  carrier,  of  frequency  w0  (identical  to  the  center  frequency  of  the  x{ ’s) 
and  with  uniform  random  phase,  <f>,  is  used  to  heterodyne  the  observations  down 
to  zero  frequency.  These  envelopes  are  then  mixed  into  the  observations  to  form 
the  composite  bandpass  and  envelope  waveforms,  Xj  and  x2.  The  mixture  of  the 
envelopes  into  the  observations  is  controlled  by  the  parameter  a  where  a  £  [0,1], 
The  resultant  composite  waveforms  are  subsequently  processed  by  a  classical 
GCC  to  form  the  peak  estimate  of  time  delay,  D.  Note  that  the  stationarity  of 
the  observations,  and  the  random  phase  assumption  on  the  heterodyne  waveform, 
imply  that  the  spectra,  $n(u>)  and  ^(w),  and  cross-spectrum,  4>12(w),  of  xt  and 
x2  are  simply 

$,y  (w)  =  a2G{j  (u>)  +  (l-a)2G,y  (M-w, )  ,  »,  ;  =  1,  2  (7) 

Here,  as  in  Chapter  2,  G,y  denote  the  various  auto-  and  cross-spectra  of  the  origi¬ 
nal  observations  xx  and  x2. 

We  will  consider  the  following  particular  penalty  function  on  the  GCC 
weight  W[w)  (local  performance  measure) 

p{W)  =  varL  ( D )  +  -L  SNR  f 1 


(8) 
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where  varL  denotes  the  local  variance,  Eq.  (23)  of  Chapter  3,  and  SNR  {  is  the 
SNR  introduced  in  Chapter  2,  Eq.  (12),  and  discussed  in  the  previous  section  in 
connection  with  the  BLB,  Eq.  (4).  Note  the  above  measures  are  with  respect  to 
the  estimate  yielded  by  the  hybrid  GCC-GCC-envelope-processor. 

The  specific  combination  of  processor  structure  and  penalty  function  ,  Fig. 
4.1  and  Eq.  (8),  was  chosen  because  of  our  ability  to  emphasize  locally  optimal 
performance  at  either  high  or  low  SNR  by  choice  of  a.  Indeed,  for  a  =  1,  Eq. 
(8)  takes  its  global  minimum  when  the  locally  optimal  HT  weight,  WHT(w)  in 
Eq.  (6),  is  used  in  place  of  W{w)  in  Fig.  4  1,  while  for  a  =  0,  the  minimum  is 
attained  for  the  HT  implementation  of  the  GCC  envelope  processor,  i.e. 
W(w)  =  WHT{\w\-w0 ).  Thus  a  can  be  considered  a  parameter  which  adjusts  the 
sensitivity  of  the  penalty  function  to  the  SNR  operating  point  of  the  hybrid  pro- 
cessor. 

In  addition  to  local  performance,  characterized  by  p(  W),  we  are  interested  in 
good  large  error  performance  of  the  hybrid  GCC  with  filter  W.  In  this  aim  we 
impose  the  following  inequality  constraints  on  the  envelope  of  the  GCC  output, 
R3  in  Fig.  4.1. 

E[-^r  fi'MUol  <-K  (9) 

)|<  r.  ,  N  (10) 

In  (9),  K  is  the  magnitude  of  the  curvature  of  the  output  of  the  hybrid  processor 
at  the  true  delay.  Therefore  (9)  constrains  the  resolution  of  the  peak  at  D  rela¬ 
tive  to  small  errors.  Eq.  (10),  on  the  other  hand,  constrains  the  resolution  rela¬ 
tive  to  large  errors  by  maintaining  low  magnitude  sidelobes  (low  magnitude 
envelope  curvature).  The  particular  form  of  constraints  (9)  and  (10),  for  the 
GCC  with  weight  W[w),  can  be  derived  from  Chapter  2,  Eq.  (4),  and  the  assump- 
tions  contained  therein,  by  identifying 
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A  00 

Ei77  *?(r)Uz>]  =  “  I v2\g l2(w)\w{w)dw 

-CO 


(11) 


E  [R9{D 


n2r 

Wo 


n2r 


/l<M2(®)|W{w)e  **  rfu; 


(12) 


The  expressions  for  the  GCC  local  variance  and  SNR  t  are  obtained  from  Eq. 
(23)  of  Chapter  3  and  Eq.  (12)  of  Chapter  2,  by  substituting  the  present  input 
spectra,  of  Eqs.  (7)  and  (9),  in  place  of  the  spectra  contained  in  formulas  (23)  and 
(12)  of  Chapter  3  and  Chapter  2.  The  results  are 


and 


/  w2F[w)\  W[w)\2dw 
varL  (D)  =  -°° 


i  00 

—  /  w2C{w)W{w)dw 


(13) 


SNR  f 1 


1 

2irT 


_L_ 

2  7T 


co 

/  F(u;)|  W(u;)|2(/u; 


-CO 


oo 


7 


J  G(w)  W[w)dw 

-oo 


(14) 


where  the  following  spectral  products  have  been  defined  in  terms  of  the  spectra 
of  ij  and  i2,  $ty(u>)f  i,j  =  1,2 


and 


G(w)  =  |*12(»)| 


(15) 


F(w)  =  $n(u;)$22(u;)  -  G2(w)  (16) 

In  the  present  case  we  are  interested  in  highly  narrowband  bandpass  signal 
spectra.  In  this  case  the  substantial  portion  of  signal  energy  lies  within  the  nar¬ 
row  frequency  region  |u;|  £  [wa  -B/2,wg  +B/2].  For  the  proposed  hybrid  imple¬ 
mentation  of  Fig.  4.1,  this  implies  that  the  inputs  to  the  GCC  ,  x  j  and  x„,  will 
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have  negligible  signal  related  energy  outside  of  narrow  regions  centered  about  w0 
and  zero  frequencies.  Certainly  any  reasonable  weight  W(u;)  will  attenuate  the 
components  of  the  GCC  inputs  outside  of  these  regions.  Consequently,  as  will  be 
seen,  the  optimization  of  the  bandpass  and  lowpass  partions  of  W(w)  can  be 
decoupled.  For  a  typical  W(u/)  see  Fig.  4.2. 

Inequality  constrained  minimization  problems  can  be  attacked  in  different 
ways,  see  e.g.  [6|.  Since  the  object  here  is  to  quickly  arrive  at  an  optimal  struc¬ 
ture,  we  will  assume  that  the  so  called  Kuhn-Tucker  conditions  are  satisfied  for 
the  constrained  minimization  of  p{W),  (8)  subject  to  (9)  and  (10).  In  this  case  a 
necessary  condition  for  a  given  W{w)  to  be  optimal,  in  the  sense  of  minimizing  p 
over  the  constraint  region  defined  by  (9)  and  (10),  is  that  it  be  a  stationary  point 
of  the  Euler-Lagrange  form 

(17) 

varL(D)  +  ^j  SNR  f 1  +?<,E[-~  +  E  X,.E[^(£+—  )] 

uT  \T  W 

o  n»-iV  ^  o 

Where  $0  and  X,-  i=-N,..,0,..N  are  constant  multipliers  which  are  yet  to  be 
determined,  and  depend  on  the  constraint  regions.  The  form  (17)  can  be  written 
explicitly  as  an  integral  over  frequency  of  the  functions  of  observation  spectra, 
Eqs.  (15)  and  (16),  and  the  GCC  weight  W(uj) 

00 

/  dw  w2F\w)-^  \W(w)\2  +  |W(u/)|2  (18) 

-co  N  r0 

..  . 

W  ;to - 

+  w2G(w)  W(u;)  +  \n  e  w'  G(w)W[w) 

n—-N 

Now  express  F{w)  and  G(u>)  in  (18)  in  terms  of  the  spectra  $,y(w)  (See  Eqs  (15), 
(16)).  These  quantities  can  in  turn  be  expressed  in  terms  of  the  disjoint  spectra 
Gy  ( w )  and  G{-  (|  w|— )  (See  Eq.  (7))  to  yield  the  equivalent  form  to  (18) 
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)G0(w)W[w) 


(19) 


)Ge  ( w)  W(  w)  dw 


where  Fg  and  G0  are  products  of  the  nominal  bandpass  spectra  of  the  observa¬ 
tions 


F»  H  =  -  |7i2(«')|2)  ,  G0  (w)  =  |G12(u>)|  (20) 


and  F e  and  Gt  are  the  lowpass  equivalent  spectra  to  the  above 


Ft  ( w )  =  F0{\w\  -wg),  Ge  (w)  =  G0  (|u;|  -  w9 ) 


(21) 


It  has  been  observed  that  PV(tf)  is  significantly  different  from  zero  only  on  the 
support  of  Ga ,  F 0  and  Ge ,  Fe ,  which  are  highly  concentrated  in 
M  £  [  wo~B/2,  w0+B/2]  and  w  £  [-B/ 2,  B/2]  respectively.  As  a  consequence, 
the  specification  of  W[w)  over  the  bandpass  frequency  region  can  be  made 
independently  of  that  of  W(t/;)  over  the  lowpass  frequency  region  -(the  two  terms 
in  brackets,  in  (19)  are  non-zero  over  essentially  disjoint  frequency  regions). 
(19)  can  therefore  be  decomposed  into  two  seperate  forms  to  be  minimized,  the 
one  involving  the  bandpass  spectra,  F0 ,  G0  and  the  other  involving  the  lowpass 


Formal  differentiation  of  the  resulting  equations  with  respect  to  H^w)  yields 
the  following  necessary  conditions  for  W[w)  to  be  an  optimal  GCC  weight,  which 
we  denote  Wapt  ( w) 


(22) 
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Here  a2  =  K2/r2.  Observe  that  \0  can  be  expressed  as  X„  =  X'  +  a2,  for 

some  constant  X  .  Hence,  without  loss  of  generality,  we  can  rewrite  Eq.  (22)  in 
its  final  form 


FA*) 


FA*) 


K  + 


1 

w2  +  a2 


X„  « 


n  2x 


(23) 


where  we  have  ignored  any  constant  scaling  of  Wopt . 


From  the  defining  relations  of  G0,  Fg,  Ge,  and  Fe  ,  Eqs.  (20)  and  (21), 
recognize  the  locally  optimal  HT  weights  WHT(w)  and  WHT(\w\-w0)  for  the 
observations  and  their  envelopes  respectively 


WWW  = 


GAM 

FAM 


(24) 


G.  (w) 

Wht(\w\-w0  )  =  —  (25) 

F t  (») 

The  sum  G0jFt  +  Ge/Fe,  in  Eq,  (23),  will  be  denoted  the  locally  optimal 
hybrid  weighting  Wlo  («;). 

The  structure  of  the  optimal  hybrid  processor  is  displayed  in  Fig.  4.3  in 
block  diagram  format.  Here  the  notation  TDL  denotes  the  implementation  of  the 
sum  of  weighted  exponentials  in  (23)  as  a  tapped  delay  line.  The  processor 
reduces  to  the  following  sequence  of  operations  on  the  composite  waveform  x  j 
and  x2.  First  locally  optimal  processing  is  performed  on  the  composite 
waveforms  using  the  Hannan-Thomson  locally  optimal  (hybrid)  weighting,  Wlo ; 
the  sum  of  (24)  and  (25),  in  a  conventional  GCC.  The  output  of  the  GCC  is  then 
passed  through  a  two  branch  network.  One  of  these  branches,  the  lower  one  in 
Fig.  4.3,  simply  implements  the  locally  optimal  estimator  by  passing  a  scaled  ver¬ 
sion  of  the  output  of  Wlo  directly  to  the  output,  R  J .  The  other  branch  is  more 
interesting.  It  takes  the  ambiguity  prone  output  of  Wlg  and  performs 
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equalization,  via  a  tapped  delay  line  structure,  to  minimize  sidelobe  activity.  The 
resultant  waveform  is  then  lowpass  filtered  to  remove  spurious  high  frequency 
peaks,  which  could  cause  ambiguity.  Finally  the  equalized  and  filtered  waveform 
is  combined  with  the  locally  optimal  GOO  output  to  form  the  peak  generating 
sample  cross-correlation  function,  R g . 

As  the  above  development  suggests,  the  final  configuration  is  intuitively 
satisfying.  The  next  step  would  be  to  simulate  the  processor  and  compare  it  to 
others  which  have  been  designed  for  narrowband  lowpass  signals,  e.g.  the 
Hassab-Boucher  (HB),  reference  [2)  of  Chapter  2,  and  the  simple  envelope  GCC 
suggested  in  [4].  This  will  be  a  subject  of  a  future  study. 

V.  Conversion  to  a  Pseudo-linear  Form. 

Here  some  ideas  and  preliminary  results  are  presented  concerning  a  pro¬ 
cedure  which  transforms  the  multi-waveform,  non-linear  time  delay  estimation 
problem:  estimate  D  E  [~Dm  ,Dm  ]  from 

*l(t)  =  40  +  »i(f)  (26) 

te[o,T] 

xz(t)  =  s(t-D)  +  n2(f) 

into  the  single  waveform,  pseudo-linear,  time  delay  estimation  problem 

H[t)  =  D  +  rj{t)  t£[tvt2]  (27) 

where,  under  certain  assumptions  on  the  signal,  s(t),  t](t)  is  a  non-stationary  noise 
process,  ^2  ^  a  constant,  and  1 1  is  a  parameter  determined  by  a  ”  genie”  algo¬ 
rithm,  to  be  specified  in  a  moment.  We  use  the  ” pseudo-linear”  nomenclature  for 
(27)  since  t  i  depends  on  D  in  practice.  The  transformation  yields  a  sufficient 
statistic,  so  that  the  resultant  statistic  (related  to  H{t)  above)  contains  as  much 
information  on  the  delay  parameter  as  the  original  observations  (26). 
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Although  the  technique  can  be  applied  to  the  original  Gaussian  signal  case 
(In  which  case  D  gets  multiplied  by  a  random  process,  dependent  on  D,  in  (27)), 
the  treatment  to  follow  will  be  restricted  to  the  deterministic  signal  case.  How¬ 
ever  D  may  be  a  random  variable.  Two  specific  signal  characteristics  will  be  con¬ 
sidered:  1)  s(t)  of  finite  time  duration  (finite  energy),  Te ;  and  2)  s(<)  periodic 
with  period  Ts  and  low  duty  cycle.  For  1),  the  signal,  and  its  delayed  version, 
are  assumed  to  be  entirely  contained  in  the  observation  interval  [0,7].  For  2), 
the  delay  is  restricted  to  the  interval  \-Dm  ,Dm  ]  =  [~TS  /2 ,TS  /2]. 

As  before,  form  the  sample  cross-correlation  function  between  ij  and  x<> 

1  r 

=  ^  /  x^x^t+^dt  ,  tG[-T,T)  (28) 

1  o 

Recall  the  decomposition  of  R 12  in  Chapter  2  ,  Eq.  (5).  The  identical  result 
holds  here  once  the  signal  auto-correlation  function  is  defined  for  the  determinis¬ 
tic  case 

T 

R„(r)  =  fs(t)s(t+r)dt  (29) 

0 


for  the  finite  energy  signal,  and 

r 

R,AT)  =  ^  /s(W+r)<ft  (30) 

1  o 

for  the  periodic  signal.  In  defining  (29)  and  (30)  we  have  used  the  assumptions 
on  the  time  extents  and  period  of  s(t)  and  s(t-D),  discussed  in  the  preceeding 
paragraph,  to  ensure  that  (29)  and  (30)  are  well  defined  (independent  of  T).  The 
decomposition  of  (28)  can  then  be  expressed  in  the  form 

R  n(T)  =  r(r-D)  +  (r)  (31) 

where  Rn  is  the  sample  cross-correlation  between  the  different  noise  and  signal 
times  noise  terms  in  R  12 
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T 


Rn  (T)  =  4t  /  (s(f)n2(*+r)  +  nj(/)s(f-Z)+7)  +  n1(l)n2(f+r))  dt  (32) 
1  o 


and 


rir)  =  y  R„  (r) 


(33) 


for  the  finite  energy  case,  and 


ir)  =  R„  (?) 


(34) 


for  the  periodic  signal. 


It  is  straightforward  to  show  that  R„  ,  in  (29)  and  (30),  takes  its  global  max¬ 


imum  at  D  and  is  also  symmetric  about  D.  Therefore  r(r)  can  be  regarded  as  a 


true  autocorrelation  function.  This  is  in  contrast  to  the  random  signal  case, 


where  in  the  decomposition  of  Chapter  2,  Eq.  (5),  R„  is  only  an  asymptotic 


approximation  to  an  auto-correlation  function. 

It  is  immediately  verified  that  the  cross-correlation  noise,  Rn  in  (32)  is  zero 
mean,  as  in  the  random  signal  case  (See  Chapter  3).  A  bit  more  tedious,  is  the 
calculation  of  the  covariance,  a (f,r),  of  Rn  ,  which  is,  however,  derived  analo¬ 
gously  to  the  derivation  in  Chapter  3,  Appendix  C,  for  the  random  case.  The 
result  is 


(35) 

)  +  /UM-Mr <'>(?)  +  fl„1(e)r<2>({,(,r,D)|  if 


where 


.  Hei 

r(1)(f)  —  /  a(z/)s(i/+|£|)du 

1  o 


(36) 


and 


,  r-Kl 

rW{£,t,T,D)  =  —  /  4v+t-D+\(\)a(v+t-D+T)dv 

1 


0 


(37) 
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a.nd  Rn{ ,  i  —  1,2  ,  are  the  autocorrelation  functions  of  the  observation  noise,  n, 
in  (26).  Note,  as  in  the  random  signal  case,  the  covariance  is  a  function  of  D  and 
depends  on  t  and  r  in  addition  to  t  —  r. 

Define  the  constant  L 

L  =  Dm  +  Te  (38) 

and  the  (linear)  function  of  R 12 

t 

H(t)  =  f  rf?12(r)dr  ,  t  e  \-L,L]  (39) 

-L 

Note  that  H  is  invertible  (  R  12(r)  =  I  dH[r)/dT  ).  Use  the  decomposition,  (31), 
in  (39)  to  obtain 

t  t 

H{t)  =  /  tt{t-D)<1t+  /  ?Rn  ( t)<It  ,  t  E  \-L,L]  (40) 

-L  -L 

Now  make  a  change  of  variable  in  the  first  integral  on  the  right  of  the  equality 
(40)  and  identify  the  noise  term  t] 

t-D  t-D 

H(t)  =  D  j  r(r)dr+  +  /  rr(r)</r  +  rj(t)  (41) 

-L-D  -L-D 

where 

t 

rj(t)  =  f  TRn(r)dr  (42) 

-L 

The  covariance  of  tj  can  be  calculated  straightforwardly  from  Eq.  (35) 

t  T 

&  ( tj )  =  /  du  /  d{i  <t(i y,fi)  (43) 

-L  -L 

In  its  present  form,  Eq.  (41)  is  not  quite  linear  in  D.  However,  if  r(r)  is  of 
width  Tc ,  then,  because  of  the  symmetry  of  r(r),  the  first  two  integrals  in  (41) 
are  zero  for  -L  <  t  <  D-Te  ,  and  the  first  integral  is  a  known  constant,  the 
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second  zero,  for  D+Te  <  t  <  L.  As  a  consequence,  neglecting  the  influence  of 
the  D-dependent  noise,  Rn ,  H[t)  is  linear  in  D  over  the  latter  interval,  and 
independent  of  D  over  the  former. 

For  simplicity  assume  that  r(7)  is  a  narrow  pulse  (broadband  signal  case). 
Then  make  the  approximation 

H[t)  =  Dv{t-D)  +  rj{t)  ,  te[-L,L]  (44) 

where  v{t)  is  the  unit  step  function,  taking  values  zero,  for  negative  r,  and  one, 
for  positive  r.  For  unknown,  deterministic  D,  the  maximum-likelihood  estimate 
of  D  can  be  specified  under  a  Gaussian  assumption  on  the  zero  mean  noise,  77(f). 
The  resultant  (classical)  estimator  is  illustrated  in  Fig.  5.1,  which  seeks  to  minim¬ 
ize  the  (prewhitened)  residuals  between  H(t )  and  Du{t-D).  Observe  that  the  esti¬ 
mate  D  updates  the  "inverse  filter”:  i?„_1(f,r).  Here  Rn~l  is  the  inverse  kernel 
associated  with  the  noise  covariance  of  (43),  defined  such  that 

L 

6(r-t)  =  /  R-\Tyv)o*  ( u,t)dv  (45) 

—Li 

For  a  low  SNR  condition  and  white  noises  of  power  N0  /2,  the  estimator  of 
Fig.  5.1  no  longer  needs  to  update  the  inverse  kernel  R~l.  This  comes  from  the 
D- independent  form  of  the  covariance,  Eq.  (43),  of  77  for  low  SNR 

✓  (r.O  =  +  ^  (46) 

It  remains  to  be  determined  if  the  time  varying  inverse  filter,  i?n-1  of  (45),  is  of 
simple  enough  form  to  be  a  practical  implementation. 

The  maximum  likelihood  estimator  (MLE)  is  an  optimal  implementation. 
However,  the  "signal”,  D,  is  only  present  for  a  portion  of  the  time  interval  \-L,L\. 
Consequently  the  MLE,  implemented  as  above,  over-utilizes  the  data,  part  of 
which  may  be  purely  observation  noise.  An  alternate,  possibly  sub-optimal,  pro- 
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cedure  would  involve  the  implementation  of  a  causal,  joint  estimation-detection 
scheme  to  estimate  D  from  H{t).  Essentially  one  would  begin  observing  H(t)  at 
t  =  L,  and  form  an  estimate  of  D,  D{t),  as  t  decreases  to  t  =  L-Te  (In  this 
interval  it  is  known  that  the  signal  D  is  present  in  the  observations  (41)).  For 
t  <  L-Te ,  the  estimate  D(t)  could  be  used  as  evolving  a  priori  information  in  a 
hypothesis  test  of  the  presence  or  absence  of  the  "signal”  D  in  additive  noise  rj(t). 
When  the  detection  algorithm  indicates  the  absence  of  D  in  the  observations, 
H(t),  the  estimation  procedure  is  terminated.  The  above  approach  converts  the 
estimation  problem,  (41),  into  the  linear  problem  of  (27),  where  the  ”genie”  is 
identified  with  the  detection  algorithm,  and  t2  =  L.  The  details  of  the  proposed 
estimation-detection  scheme  remain  to  be  determined  by  future  study. 

Some  insight  into  the  performance  of  the  MLE  of  Fig.  5.1,  for  low  SNR  and 
white  noise,  may  be  obtained  from  considering  the  performance  of  the  following 
simple  estimate  of  D 


frirjdr 

-L 


(47) 


where  L  is  defined  in  (38).  Note,  it  must  be  assumed  that  the  integral  in  (47)  is 
greater  than  zero  for  the  estimate  to  be  well  defined.  This  is  true  if  r(r)  is  strictly 
positive  definite,  or  if  there  is  a  DC  component  in  the  signal  auto-correlation 
function.  Since  only  a  single  point  of  H[t),  H{L),  is  used  in  (47)  and  no  inverse 
filtering  is  implemented,  D  of  (47)  is  sub-optimal,  in  comparison  to  the  MLE. 
The  estimate  (47)  is  unbiased  since  the  mean  of  q,  Eq.  (42),  is  zero  and  in  (41) 

L-D  L  L-D  L 

f  r(r)dr  =  / r{r)dr  and  /  rr{r)dr  =  / Tr(r)dr  =  0  (48) 

-L-D  -L  -L-D  -L 

by  virtue  of  the  definition  of  L,  given  in  (38),  and  the  fact  that  the  symmetric 
function  r(r)  is  zero  outside  of  r  £  [~Te  ,Te  ]. 
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As  a  simple  example  for  the  finite  energy  case,  consider  the  case  of  a  tri¬ 
angular  shaped  signal  auto-correlation  of  width  2  Te  and  maximum  S  at  zero.  In 
this  case 

f  .  ,  .  ST, 

$r{T)dT  =  (49) 

and  the  low  SNR  variance  of  the  estimate  (47)  is  obtained  immediately  from  (41), 
(43)  and  (46) 


var[D\  = 


j  IL,L 


L 

/r(r)rfr 

-L 


LT{-!jh  f 

_ _  c 

6  SNp 


(50) 


Recall,  L  Dm  4*  Te  and  SNR  —  S/N0 .  Eq.  (50)  indicates  some  of  the  impor¬ 
tant  performance  factors.  There  are  tradeoffs  between  Dm ,  T  and  Tc  .  In  prin¬ 
ciple,  unlike  the  random  signal  case,  performance  does  not  decrease  with  increas¬ 
ing  T  since  the  noise  dominates  over  all  but  a  time  interval  of  length  Te  .  For 
the  same  reason,  in  contrast  to  the  behavior  of  the  GCC  at  high  SNR  for  random 
signals,  the  broader  the  signal  auto-correlation,  over  the  a  priori  region  (small 
L/Te ),  the  lower  the  variance.  Increasing  Dm ,  on  the  other  hand,  has  analogous 
effects  on  performance  as  in  the  random  signal  case;  it  introduces  more  uncer¬ 
tainty  into  the  delay  parameter  over  time,  thus  increasing  the  error. 

For  the  periodic  signal  case,  let  the  autocorrelation  function  consist  of 
copies  of  the  triangular  autocorrelation  function  studied  above,  with  inter¬ 
spacing  Ts,  where  Te«Ts.  With  the  assumption  Ts>Dm+Tc  (no  ambi¬ 
guity  because  of  phase),  the  variance  for  low  SNR  becomes 


var\D\  — 


6  SNR2 


(51) 
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The  form  of  (51)  is  identical  to  (50)  except  for  the  dependence  on  T.  Here  the 
variance  decreases  with  increasing  T  since  infinite  signal  observation  time  is 
available. 

For  the  deterministic  (radar)  signal,  the  expressions  for  the  variance  of  the 
conventional  time  delay  estimator  known  to  us  are  valid  only  for  small  errors,  i.e. 
high  SNR,  or  for  special  signal  situations  (e.g.  white  or  Markovian  signals  and 
noises  [7]).  Since  (51)  and  (50)  are  valid  only  for  low  SNR -and  involve  additional 
parameters  absent  in  the  conventional  estimator  (e.g.  L),  comparison  of  the  per¬ 
formance  of  the  linearized  procedure,  discussed  here,  with  that  of  conventional 
techniques  is  difficult.  Further  research  into  the  relative  merits  of  this  estimation 
scheme  is  necessary,  before  any  general  conclusions  can  be  drawn. 

VI.  Conclusions 

The  two  signal  processing  schemes  introduced  in  this  chapter  take  interest¬ 
ing  forms.  However,  additional  study  is  needed  to  quantify  the  relative  perfor¬ 
mance  of  these  methods  with  respect  to  the  conventional  techniques. 

For  the  hybrid  GCC-GCC  envelope  processor,  a  deeper  analysis  into  the 
necessary  conditions  for  the  optimality  of  the  structure  of  Fig.  4.3  for  the  con¬ 
strained  minimization  is  necessary.  In  particular,  one  needs  to  know  how  to 
choose  the  various  design  parameters  such  that  a),  a  solution  of  the  constrained 
optimization  exists,  and  if  so  b).  the  implementation  of  the  resultant  processor  is 
sufficiently  simple.  For  example,  the  choice  of  a,  the  observation  versus  envelope 
mixture  parameter,  should  correspond  to  the  (perhaps  changing)  priorities  of  high 
vs.  low  SNR  performance.  Furthermore,  the  number  and  magnitude  of  the  con¬ 
straint  boundaries  will  certainly  have  an  impact  on  the  performance,  complexity 
and  even  the  existence  of  the  optimal  estimator. 

The  linearization  method,  discussed  in  Section  V,  is  only  (approximately) 
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linear  for  certain  characteristic  (deterministic)  signal  forms.  For  the  general  case 
the  transformed  cross-correlation  function  remains  non-linear,  a  sum  of  a  linear 
function  of  D  and  the  product  of  two  linear  functions  of  D.  However,  the  non¬ 
linearity  may  be  a  simple  non-linearity  (i.e.  easy  to  invert).  This  will  be  signal 
dependent,  and  suggests  the  investigation  of  signal  design  for  this  technique.  The 
performance  of  the  method,  in  any  case,  remains  to  be  thoroughly  investigated. 
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Chapter  7 
Conclusion 

Two  sensor,  passive  time  delay  estimation  has  been  considered  in  this  disser¬ 
tation.  Both  the  development  of  new  estimators  and  the  characterization  of  esti¬ 
mator  performance  have  been  of  interest.  Of  prime  concern,  however,  have  been 
two  situations  for  which  the  conventional  correlation  type  delay  estimators 
display  poor  performance:  unknown  observation  spectra,  and  low  time-bandwidth 
product  (BT). 

In  Chapter  1,  cross-correlation  of  the  least  mean  square  estimates  (LMSE)  of 
the  signal  and  its  delayed  version  gave  a  new  correlation  type  delay  estimate, 
the  Wiener  Processor  (WP).  For  partially  unknown  observation  spectra,  replace¬ 
ment  of  the  LMSEs  by  robust  (min-max)  estimates  in  the  WP  gave  the  Robust 
Wiener  Processor  (RWP).  The  RWP  represents  a  first  step  in  obtaining  min-max 
time  delay  estimates  for  the  difficult  case  of  unknown  spectra. 

Chapters  3  and  6  introduced  alternate  processing  strategies  designed  to 
improve  upon  the  conventional  techniques  for  narrowband  signals  (low  BT).  The 
Center  of  Symmetry  Estimate  (CSE)  was  proposed  in  Chapter  3  as  a  way  to 
desensitize  the  estimate  to  large  errors  (outliers).  In  Chapter  6,  a  combined  sig¬ 
nal  and  signal  envelope  correlation  type  processor  was  optimized  to  yield  a  novel 
estimator  structure  for  narrowband  bandpass  signals. 

In  Chapters  4  and  5  the  attention  was  focused  on  the  theory  of  upcrossing 
probabilities  and  their  application  to  modeling  the  large  error  performance  of 
correlation  type  time  delay  estimates.  Chapter  4  represents  an  extension  of  the 
existing  results  on  the  asymptotic  distribution  of  the  level  crossings  of  a  station¬ 
ary,  continuous  time  random  process  to  the  non-stationary  case.  Then,  a  level 
crossing  model  for  large  delay  estimator  errors  was  taken  in  Chapter  5.  The 
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approach  taken  in  Chapter  5  is  more  general  than  the  previous  large  error 
approximations  in  that  it  can  be  applied  to  the  case  of  bandpass  as  well  as 
lowpass  signals.  Motivated  by  the  results  of  Chapter  4,  approximations  to  the 
probability  of  large  error  and  the  estimator  variance  were  derived.  For  large  BT, 
and  lowpass  signal  spectra,  the  approximations  are  in  good  agreement  with  the 
simulated  performance  of  the  cross-correlator.  For  bandpass  spectra  they  are 
consistent  with  the  relevant  performance  predictions  of  the  Ziv-Zakai  lower 
bound  on  achievable  error. 

At  the  conclusion  of  this  research  several  avenues  are  open  for  future  study. 
Extensions  to  more  general  observation  models  than  that  treated  here  warrant 
investigation.  Of  special  interest  is  the  case  of  correlated  noise  and  signal  com¬ 
ponents,  which  occurs  in  multipath  and  reverberation  environments.  Also  of 
interest  is  the  multi-sensor  situation.  In  both  of  the  above  scenarios  the  pairwise 
sensor  cross-correlations  cease  to  be  sufficient  statistics  for  the  inter-sensor 
delays.  Therefore  a  substantially  different  approach  than  that  taken  in  this 
thesis  may  be  necessary.  Likewise,  the  case  of  a  time  evolving  delay  parameter, 
as  occurs  in  tracking,  introduces  further  complexity  into  the  estimation  problem. 
However,  in  the  latter  case  the  sample  cross-correlation  function  remains  suffi¬ 
cient  for  the  delay.  Consequently,  in  this  case,  some  extensions  of  the  present 
work  may  be  possible. 
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